Aug 26 21:53:06 user nova-compute[72929]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 26 21:53:09 user nova-compute[72929]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72929) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72929) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72929) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 26 21:53:09 user nova-compute[72929]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:53:09 user nova-compute[72929]: INFO nova.virt.driver [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 26 21:53:09 user nova-compute[72929]: INFO nova.compute.provider_config [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Acquiring lock "singleton_lock" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Acquired lock "singleton_lock" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Releasing lock "singleton_lock" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Full set of CONF: {{(pid=72929) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ******************************************************************************** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Configuration options gathered from: {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ================================================================================ {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] allow_resize_to_same_host      = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] arq_binding_timeout            = 300 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] backdoor_port                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] backdoor_socket                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] block_device_allocate_retries  = 300 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] block_device_allocate_retries_interval = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cert                           = self.pem {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute_monitors               = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] config_dir                     = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] config_drive_format            = iso9660 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] config_source                  = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] console_host                   = user {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] control_exchange               = nova {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cpu_allocation_ratio           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] daemon                         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] debug                          = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] default_access_ip_network_name = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] default_availability_zone      = nova {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] default_ephemeral_format       = ext4 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] default_green_pool_size        = 1000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] default_schedule_zone          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] disk_allocation_ratio          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] enable_new_services            = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] enabled_ssl_apis               = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] flat_injected                  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] force_config_drive             = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] force_raw_images               = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] graceful_shutdown_timeout      = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] heal_instance_info_cache_interval = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] host                           = user {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_build_timeout         = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_delete_interval       = 300 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_name_template         = instance-%08x {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_usage_audit           = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_usage_audit_period    = month {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] internal_service_availability_zone = internal {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] key                            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] live_migration_retry_count     = 30 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_config_append              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_dir                        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_file                       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_options                    = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_rotate_interval            = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_rotate_interval_type       = days {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] log_rotation_type              = none {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] long_rpc_timeout               = 1800 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] max_concurrent_builds          = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] max_concurrent_live_migrations = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] max_concurrent_snapshots       = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] max_local_block_devices        = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] max_logfile_count              = 30 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] max_logfile_size_mb            = 200 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] maximum_instance_delete_attempts = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metadata_listen                = 0.0.0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metadata_listen_port           = 8775 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metadata_workers               = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] migrate_max_retries            = -1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] mkisofs_cmd                    = genisoimage {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] my_ip                          = 10.0.0.210 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] network_allocate_retries       = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] osapi_compute_listen_port      = 8774 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] osapi_compute_unique_server_name_scope =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] osapi_compute_workers          = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] password_length                = 12 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] periodic_enable                = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] periodic_fuzzy_delay           = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] pointer_model                  = ps2mouse {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] preallocate_images             = none {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] publish_errors                 = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] pybasedir                      = /opt/stack/nova {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ram_allocation_ratio           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rate_limit_burst               = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rate_limit_except_level        = CRITICAL {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rate_limit_interval            = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reboot_timeout                 = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reclaim_instance_interval      = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] record                         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reimage_timeout_per_gb         = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] report_interval                = 120 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rescue_timeout                 = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reserved_host_cpus             = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reserved_host_disk_mb          = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reserved_host_memory_mb        = 512 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] reserved_huge_pages            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] resize_confirm_window          = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] resize_fs_using_block_device   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] resume_guests_state_on_host_boot = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rpc_response_timeout           = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] run_external_periodic_tasks    = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] running_deleted_instance_action = reap {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] running_deleted_instance_timeout = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler_instance_sync_interval = 120 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_down_time              = 720 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] servicegroup_driver            = db {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] shelved_offload_time           = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] shelved_poll_interval          = 3600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] shutdown_timeout               = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] source_is_ipv6                 = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ssl_only                       = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] state_path                     = /opt/stack/data/nova {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] sync_power_state_interval      = 600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] sync_power_state_pool_size     = 1000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] syslog_log_facility            = LOG_USER {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] tempdir                        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] timeout_nbd                    = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] transport_url                  = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] update_resources_interval      = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_cow_images                 = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_eventlog                   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_journal                    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_json                       = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_rootwrap_daemon            = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_stderr                     = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] use_syslog                     = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vcpu_pin_set                   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plugging_is_fatal          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plugging_timeout           = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] virt_mkfs                      = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] volume_usage_poll_interval     = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] watch_log_file                 = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] web                            = /usr/share/spice-html5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_concurrency.disable_process_locking = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.auth_strategy              = keystone {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.compute_link_prefix        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.dhcp_domain                = novalocal {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.enable_instance_password   = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.glance_link_prefix         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.instance_list_per_project_cells = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.list_records_by_skipping_down_cells = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.local_metadata_per_cell    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.max_limit                  = 1000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.metadata_cache_expiration  = 15 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.neutron_default_tenant_id  = default {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.use_forwarded_for          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.use_neutron_default_nets   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_dynamic_targets = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_jsonfile_path   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.backend_argument         = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.config_prefix            = cache.oslo {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.dead_timeout             = 60.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.debug_cache_backend      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.enable_retry_client      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.enable_socket_keepalive  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.enabled                  = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.expiration_time          = 600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.hashclient_retry_attempts = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_dead_retry      = 300 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_password        =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_sasl_enabled    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.memcache_username        =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.proxies                  = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.retry_attempts           = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.retry_delay              = 0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.socket_keepalive_count   = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.socket_keepalive_idle    = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.socket_keepalive_interval = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.tls_allowed_ciphers      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.tls_cafile               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.tls_certfile             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.tls_enabled              = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cache.tls_keyfile              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.auth_section            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.auth_type               = password {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.cafile                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.certfile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.collect_timing          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.cross_az_attach         = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.debug                   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.endpoint_template       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.http_retries            = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.insecure                = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.keyfile                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.os_region_name          = RegionOne {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.split_loggers           = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cinder.timeout                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.cpu_dedicated_set      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.cpu_shared_set         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.image_type_exclude_list = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.resource_provider_association_refresh = 300 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.shutdown_retry_interval = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] conductor.workers              = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] console.allowed_origins        = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] console.ssl_ciphers            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] console.ssl_minimum_version    = default {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] consoleauth.token_ttl          = 600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.cafile                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.certfile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.collect_timing          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.connect_retries         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.connect_retry_delay     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.endpoint_override       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.insecure                = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.keyfile                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.max_version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.min_version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.region_name             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.service_name            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.service_type            = accelerator {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.split_loggers           = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.status_code_retries     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.timeout                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] cyborg.version                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.backend               = sqlalchemy {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.connection            = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.connection_debug      = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.connection_parameters =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.connection_recycle_time = 3600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.connection_trace      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.db_inc_retry_interval = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.db_max_retries        = 20 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.db_max_retry_interval = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.db_retry_interval     = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.max_overflow          = 50 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.max_pool_size         = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.max_retries           = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.mysql_enable_ndb      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.mysql_wsrep_sync_wait = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.pool_timeout          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.retry_interval        = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.slave_connection      = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] database.sqlite_synchronous    = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.backend           = sqlalchemy {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.connection        = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.connection_debug  = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.connection_parameters =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.connection_recycle_time = 3600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.connection_trace  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.db_inc_retry_interval = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.db_max_retries    = 20 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.db_max_retry_interval = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.db_retry_interval = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.max_overflow      = 50 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.max_pool_size     = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.max_retries       = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.mysql_enable_ndb  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.pool_timeout      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.retry_interval    = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.slave_connection  = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] api_database.sqlite_synchronous = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] devices.enabled_mdev_types     = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ephemeral_storage_encryption.enabled = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.api_servers             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.cafile                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.certfile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.collect_timing          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.connect_retries         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.connect_retry_delay     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.debug                   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.default_trusted_certificate_ids = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.enable_certificate_validation = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.enable_rbd_download     = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.endpoint_override       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.insecure                = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.keyfile                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.max_version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.min_version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.num_retries             = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.rbd_ceph_conf           =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.rbd_connect_timeout     = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.rbd_pool                =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.rbd_user                =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.region_name             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.service_name            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.service_type            = image {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.split_loggers           = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.status_code_retries     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.timeout                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.verify_glance_signatures = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] glance.version                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] guestfs.debug                  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.config_drive_cdrom      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.config_drive_inject_password = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.enable_remotefx         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.instances_path_share    =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.limit_cpu_features      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.use_multipath_io        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.vswitch_name            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] mks.enabled                    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] image_cache.manager_interval   = 2400 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] image_cache.precache_concurrency = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] image_cache.remove_unused_base_images = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] image_cache.subdirectory_name  = _base {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.api_max_retries         = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.api_retry_interval      = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.auth_section            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.auth_type               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.cafile                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.certfile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.collect_timing          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.connect_retries         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.connect_retry_delay     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.endpoint_override       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.insecure                = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.keyfile                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.max_version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.min_version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.partition_key           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.peer_list               = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.region_name             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.serial_console_state_timeout = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.service_name            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.service_type            = baremetal {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.split_loggers           = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.status_code_retries     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.timeout                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ironic.version                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] key_manager.fixed_key          = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.barbican_api_version  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.barbican_endpoint     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.barbican_endpoint_type = public {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.barbican_region_name  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.cafile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.certfile              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.collect_timing        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.insecure              = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.keyfile               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.number_of_retries     = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.retry_delay           = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.send_service_user_token = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.split_loggers         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.timeout               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.verify_ssl            = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican.verify_ssl_path       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.auth_section = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.auth_type = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.cafile   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.certfile = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.collect_timing = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.insecure = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.keyfile  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.split_loggers = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] barbican_service_user.timeout  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.approle_role_id          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.approle_secret_id        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.cafile                   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.certfile                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.collect_timing           = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.insecure                 = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.keyfile                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.kv_mountpoint            = secret {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.kv_version               = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.namespace                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.root_token_id            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.split_loggers            = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.ssl_ca_crt_file          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.timeout                  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.use_ssl                  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.cafile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.certfile              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.collect_timing        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.connect_retries       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.connect_retry_delay   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.endpoint_override     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.insecure              = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.keyfile               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.max_version           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.min_version           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.region_name           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.service_name          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.service_type          = identity {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.split_loggers         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.status_code_retries   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.timeout               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] keystone.version               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.connection_uri         =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_mode               = custom {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: WARNING oslo_config.cfg [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_power_governor_high = performance {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_power_management   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.device_detach_attempts = 8 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.device_detach_timeout  = 20 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.disk_cachemodes        = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.disk_prefix            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.enabled_perf_events    = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.file_backed_memory     = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.gid_maps               = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.hw_disk_discard        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.hw_machine_type        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_rbd_pool        = rbd {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_type            = default {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.images_volume_group    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.inject_key             = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.inject_partition       = -2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.inject_password        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.iscsi_iface            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.iser_use_multipath     = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_downtime = 500 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_inbound_addr = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_scheme  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_timeout_action = abort {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_tunnelled = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: WARNING oslo_config.cfg [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 26 21:53:09 user nova-compute[72929]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 26 21:53:09 user nova-compute[72929]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 26 21:53:09 user nova-compute[72929]: and ``live_migration_inbound_addr`` respectively.
Aug 26 21:53:09 user nova-compute[72929]: ).  Its value may be silently ignored in the future.
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.live_migration_with_native_tls = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.max_queues             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.nfs_mount_options      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.num_pcie_ports         = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.pmem_namespaces        = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.quobyte_client_cfg     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rbd_secret_uuid        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rbd_user               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rescue_image_id        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rescue_kernel_id       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.rx_queue_size          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.smbfs_mount_options    =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.snapshot_compression   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.snapshot_image_format  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.sparse_logical_volumes = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.swtpm_enabled          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.swtpm_group            = tss {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.swtpm_user             = tss {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.sysinfo_serial         = unique {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.tb_cache_size          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.tx_queue_size          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.uid_maps               = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.use_virtio_for_bridges = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.virt_type              = kvm {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.volume_clear           = zero {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.volume_clear_size      = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.volume_use_multipath   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_cache_path   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.auth_section           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.auth_type              = password {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.cafile                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.certfile               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.collect_timing         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.connect_retries        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.connect_retry_delay    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.default_floating_pool  = public {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.endpoint_override      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.extension_sync_interval = 600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.http_retries           = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.insecure               = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.keyfile                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.max_version            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.min_version            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.ovs_bridge             = br-int {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.physnets               = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.region_name            = RegionOne {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.service_metadata_proxy = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.service_name           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.service_type           = network {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.split_loggers          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.status_code_retries    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.timeout                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] neutron.version                = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] notifications.bdms_in_notifications = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] notifications.default_level    = INFO {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] notifications.notification_format = unversioned {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] notifications.notify_on_state_change = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] pci.alias                      = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] pci.device_spec                = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] pci.report_in_placement        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.auth_section         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.auth_type            = password {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.cafile               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.certfile             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.collect_timing       = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.connect_retries      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.connect_retry_delay  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.default_domain_id    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.default_domain_name  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.domain_id            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.domain_name          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.endpoint_override    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.insecure             = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.keyfile              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.max_version          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.min_version          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.password             = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.project_domain_id    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.project_domain_name  = Default {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.project_id           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.project_name         = service {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.region_name          = RegionOne {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.service_name         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.service_type         = placement {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.split_loggers        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.status_code_retries  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.system_scope         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.timeout              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.trust_id             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.user_domain_id       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.user_domain_name     = Default {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.user_id              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.username             = placement {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] placement.version              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.cores                    = 20 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.count_usage_from_placement = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.injected_file_content_bytes = 10240 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.injected_file_path_length = 255 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.injected_files           = 5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.instances                = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.key_pairs                = 100 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.metadata_items           = 128 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.ram                      = 51200 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.recheck_quota            = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.server_group_members     = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] quota.server_groups            = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rdp.enabled                    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.image_metadata_prefilter = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.max_attempts         = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.max_placement_results = 1000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] scheduler.workers              = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.host_subset_size = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.isolated_hosts = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.isolated_images = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.pci_in_placement = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.track_instance_changes = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metrics.required               = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metrics.weight_multiplier      = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] metrics.weight_setting         = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] serial_console.enabled         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] serial_console.port_range      = 10000:20000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] serial_console.serialproxy_port = 6083 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.auth_section      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.auth_type         = password {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.cafile            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.certfile          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.collect_timing    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.insecure          = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.keyfile           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.send_service_user_token = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.split_loggers     = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] service_user.timeout           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.agent_enabled            = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.enabled                  = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.html5proxy_port          = 6082 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.image_compression        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.jpeg_compression         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.playback_compression     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.server_listen            = 127.0.0.1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.streaming_mode           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] spice.zlib_compression         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] upgrade_levels.baseapi         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] upgrade_levels.cert            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] upgrade_levels.compute         = auto {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] upgrade_levels.conductor       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] upgrade_levels.scheduler       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.cafile = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.certfile = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.insecure = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vendordata_dynamic_auth.timeout = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.api_retry_count         = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.ca_file                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.cache_prefix            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.cluster_name            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.connection_pool_size    = 10 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.console_delay_seconds   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.datastore_regex         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.host_ip                 = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.host_password           = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.host_port               = 443 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.host_username           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.insecure                = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.integration_bridge      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.maximum_objects         = 100 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.pbm_default_policy      = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.pbm_enabled             = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.pbm_wsdl_location       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.serial_port_proxy_uri   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.serial_port_service_uri = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.task_poll_interval      = 0.5 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.use_linked_clone        = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.vnc_keymap              = en-us {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.vnc_port                = 5900 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vmware.vnc_port_total          = 10000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.auth_schemes               = ['none'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.enabled                    = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.novncproxy_port            = 6080 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.vencrypt_ca_certs          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.vencrypt_client_cert       = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vnc.vencrypt_client_key        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.disable_rootwrap   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.enable_numa_live_migration = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.libvirt_disable_apic = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.client_socket_timeout     = 900 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.default_pool_size         = 1000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.keep_alive                = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.max_header_line           = 16384 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.ssl_ca_file               = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.ssl_cert_file             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.ssl_key_file              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.tcp_keepidle              = 600 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] zvm.ca_file                    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] zvm.cloud_connector_url        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] zvm.reachable_timeout          = 300 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.enforce_new_defaults = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.enforce_scope      = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.policy_default_rule = default {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.connection_string     = messaging:// {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.enabled               = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.es_doc_type           = notification {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.es_scroll_size        = 10000 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.es_scroll_time        = 2m {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.filter_error_trace    = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.hmac_keys             = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.sentinel_service_name = mymaster {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.socket_timeout        = 0.1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.trace_requests        = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler.trace_sqlalchemy      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler_jaeger.process_tags   = {} {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler_jaeger.service_name_prefix = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] profiler_otlp.service_name_prefix = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] remote_debug.host              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] remote_debug.port              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_notifications.retry = -1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.auth_section        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.auth_type           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.cafile              = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.certfile            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.collect_timing      = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.connect_retries     = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.connect_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.endpoint_id         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.endpoint_override   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.insecure            = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.keyfile             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.max_version         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.min_version         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.region_name         = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.service_name        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.service_type        = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.split_loggers       = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.status_code_retries = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.status_code_retry_delay = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.timeout             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.valid_interfaces    = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_limit.version             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_reports.file_event_handler = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] oslo_reports.log_dir           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_ovs_privileged.group  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] vif_plug_ovs_privileged.user   = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_ovs.isolate_vif         = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] os_brick.lock_path             = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] privsep_osbrick.capabilities   = [21] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] privsep_osbrick.group          = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] privsep_osbrick.helper_command = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] privsep_osbrick.user           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] nova_sys_admin.group           = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] nova_sys_admin.helper_command  = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] nova_sys_admin.user            = None {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG oslo_service.service [None req-344b4db7-3aca-4ed5-b09a-0881ce8a5ef1 None None] ******************************************************************************** {{(pid=72929) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 26 21:53:09 user nova-compute[72929]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 26 21:53:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Starting native event thread {{(pid=72929) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Starting green dispatch thread {{(pid=72929) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Starting connection event dispatch thread {{(pid=72929) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Connecting to libvirt: qemu:///system {{(pid=72929) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0ba10ea770> {{(pid=72929) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Aug 26 21:53:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0ba10ea770> {{(pid=72929) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Aug 26 21:53:09 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Connection event '1' reason 'None'
Aug 26 21:53:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 21:53:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.mount [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Initialising _HostMountState generation 0 {{(pid=72929) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 26 21:53:17 user nova-compute[72929]: INFO nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host capabilities <capabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <host>
Aug 26 21:53:17 user nova-compute[72929]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 26 21:53:17 user nova-compute[72929]:     <cpu>
Aug 26 21:53:17 user nova-compute[72929]:       <arch>x86_64</arch>
Aug 26 21:53:17 user nova-compute[72929]:       <model>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <microcode version='1070'/>
Aug 26 21:53:17 user nova-compute[72929]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='osxsave'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='invtsc'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='rsba'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature name='skip-l1dfl-vmentry'/>
Aug 26 21:53:17 user nova-compute[72929]:       <pages unit='KiB' size='4'/>
Aug 26 21:53:17 user nova-compute[72929]:       <pages unit='KiB' size='2048'/>
Aug 26 21:53:17 user nova-compute[72929]:     </cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <power_management>
Aug 26 21:53:17 user nova-compute[72929]:       <suspend_mem/>
Aug 26 21:53:17 user nova-compute[72929]:       <suspend_disk/>
Aug 26 21:53:17 user nova-compute[72929]:       <suspend_hybrid/>
Aug 26 21:53:17 user nova-compute[72929]:     </power_management>
Aug 26 21:53:17 user nova-compute[72929]:     <iommu support='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <migration_features>
Aug 26 21:53:17 user nova-compute[72929]:       <live/>
Aug 26 21:53:17 user nova-compute[72929]:       <uri_transports>
Aug 26 21:53:17 user nova-compute[72929]:         <uri_transport>tcp</uri_transport>
Aug 26 21:53:17 user nova-compute[72929]:         <uri_transport>rdma</uri_transport>
Aug 26 21:53:17 user nova-compute[72929]:       </uri_transports>
Aug 26 21:53:17 user nova-compute[72929]:     </migration_features>
Aug 26 21:53:17 user nova-compute[72929]:     <topology>
Aug 26 21:53:17 user nova-compute[72929]:       <cells num='2'>
Aug 26 21:53:17 user nova-compute[72929]:         <cell id='0'>
Aug 26 21:53:17 user nova-compute[72929]:           <memory unit='KiB'>8189224</memory>
Aug 26 21:53:17 user nova-compute[72929]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 26 21:53:17 user nova-compute[72929]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 21:53:17 user nova-compute[72929]:           <distances>
Aug 26 21:53:17 user nova-compute[72929]:             <sibling id='0' value='10'/>
Aug 26 21:53:17 user nova-compute[72929]:             <sibling id='1' value='20'/>
Aug 26 21:53:17 user nova-compute[72929]:           </distances>
Aug 26 21:53:17 user nova-compute[72929]:           <cpus num='6'>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 26 21:53:17 user nova-compute[72929]:           </cpus>
Aug 26 21:53:17 user nova-compute[72929]:         </cell>
Aug 26 21:53:17 user nova-compute[72929]:         <cell id='1'>
Aug 26 21:53:17 user nova-compute[72929]:           <memory unit='KiB'>8206460</memory>
Aug 26 21:53:17 user nova-compute[72929]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 26 21:53:17 user nova-compute[72929]:           <pages unit='KiB' size='2048'>0</pages>
Aug 26 21:53:17 user nova-compute[72929]:           <distances>
Aug 26 21:53:17 user nova-compute[72929]:             <sibling id='0' value='20'/>
Aug 26 21:53:17 user nova-compute[72929]:             <sibling id='1' value='10'/>
Aug 26 21:53:17 user nova-compute[72929]:           </distances>
Aug 26 21:53:17 user nova-compute[72929]:           <cpus num='6'>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 26 21:53:17 user nova-compute[72929]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 26 21:53:17 user nova-compute[72929]:           </cpus>
Aug 26 21:53:17 user nova-compute[72929]:         </cell>
Aug 26 21:53:17 user nova-compute[72929]:       </cells>
Aug 26 21:53:17 user nova-compute[72929]:     </topology>
Aug 26 21:53:17 user nova-compute[72929]:     <cache>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 26 21:53:17 user nova-compute[72929]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 26 21:53:17 user nova-compute[72929]:     </cache>
Aug 26 21:53:17 user nova-compute[72929]:     <secmodel>
Aug 26 21:53:17 user nova-compute[72929]:       <model>apparmor</model>
Aug 26 21:53:17 user nova-compute[72929]:       <doi>0</doi>
Aug 26 21:53:17 user nova-compute[72929]:     </secmodel>
Aug 26 21:53:17 user nova-compute[72929]:     <secmodel>
Aug 26 21:53:17 user nova-compute[72929]:       <model>dac</model>
Aug 26 21:53:17 user nova-compute[72929]:       <doi>0</doi>
Aug 26 21:53:17 user nova-compute[72929]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 26 21:53:17 user nova-compute[72929]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 26 21:53:17 user nova-compute[72929]:     </secmodel>
Aug 26 21:53:17 user nova-compute[72929]:   </host>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='alpha'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>clipper</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='armv6l'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>spitz</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>nuri</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>kzm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sx1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>z2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>tosa</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>n810</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>n800</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>terrier</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>midway</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>microbit</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>verdex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>highbank</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>akita</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>connex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>collie</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='armv7l'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>spitz</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>nuri</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>kzm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sx1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>z2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>tosa</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>n810</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>n800</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>terrier</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>midway</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>microbit</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>verdex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>highbank</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>akita</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>connex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>collie</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='aarch64'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>integratorcp</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>borzoi</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>spitz</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>nuri</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>musca-b1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>versatileab</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>kzm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>musca-a</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>smdkc210</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sx1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>z2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>tosa</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>sabrelite</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>realview-eb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>n810</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>n800</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>versatilepb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>terrier</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mainstone</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>midway</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>musicpal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>microbit</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>cubieboard</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>verdex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>netduino2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>raspi3b</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>raspi2b</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>cheetah</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>highbank</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>akita</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>connex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>collie</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>raspi0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <acpi default='on' toggle='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='cris'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='i686'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>isapc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>microvm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='kvm'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <pae/>
Aug 26 21:53:17 user nova-compute[72929]:       <nonpae/>
Aug 26 21:53:17 user nova-compute[72929]:       <acpi default='on' toggle='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:       <apic default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='m68k'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>an5206</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>q800</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>next-cube</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='microblaze'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='microblazeel'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='mips'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='16'>malta</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='mipsel'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='16'>malta</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='mips64'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='16'>malta</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>pica61</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>magnum</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='mips64el'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='16'>malta</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mipssim</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>pica61</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>magnum</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='16'>boston</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='ppc'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mac99</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>40p</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>taihu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='ppc64'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>taihu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>40p</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mac99</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='ppc64le'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2048'>powernv9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>taihu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2048'>powernv10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ppce500</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>40p</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>pegasos2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>bamboo</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>g3beige</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>mac99</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sam460ex</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>ref405ep</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2048'>powernv8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='riscv32'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='8'>spike</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>opentitan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='8'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='riscv64'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='8'>spike</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='5'>sifive_u</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>shakti_c</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sifive_e</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='8'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='s390x'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='sh4'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>shix</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>r2d</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='sh4eb'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>shix</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>r2d</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='sparc'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>SS-5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>SS-20</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>LX</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>SS-4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>SS-10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>Voyager</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='sparc64'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sun4u</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>niagara</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>sun4v</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='x86_64'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>64</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>x-remote</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='1'>isapc</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>microvm</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='kvm'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <acpi default='on' toggle='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:       <apic default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='xtensa'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>sim</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>kc705</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ml605</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx200</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx60</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]:   <guest>
Aug 26 21:53:17 user nova-compute[72929]:     <os_type>hvm</os_type>
Aug 26 21:53:17 user nova-compute[72929]:     <arch name='xtensaeb'>
Aug 26 21:53:17 user nova-compute[72929]:       <wordsize>32</wordsize>
Aug 26 21:53:17 user nova-compute[72929]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='4'>sim</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>kc705</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ml605</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>virt</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx200</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>lx60</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 26 21:53:17 user nova-compute[72929]:       <domain type='qemu'/>
Aug 26 21:53:17 user nova-compute[72929]:     </arch>
Aug 26 21:53:17 user nova-compute[72929]:     <features>
Aug 26 21:53:17 user nova-compute[72929]:       <cpuselection/>
Aug 26 21:53:17 user nova-compute[72929]:       <deviceboot/>
Aug 26 21:53:17 user nova-compute[72929]:       <disksnapshot default='on' toggle='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     </features>
Aug 26 21:53:17 user nova-compute[72929]:   </guest>
Aug 26 21:53:17 user nova-compute[72929]: </capabilities>
Aug 26 21:53:17 user nova-compute[72929]: 
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-i440fx-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>i686</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='255'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'/>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='lm'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ide</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-q35-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>i686</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='288'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'/>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='lm'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-q35-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>i686</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='288'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'/>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='lm'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-i386</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-i440fx-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>i686</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='255'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'/>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='lm'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ide</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-i440fx-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>x86_64</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='255'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>efi</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='invtsc'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='rsba'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ide</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-q35-jammy</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>x86_64</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='288'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>efi</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='invtsc'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='rsba'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-q35-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>x86_64</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='288'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>efi</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='invtsc'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='rsba'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 26 21:53:17 user nova-compute[72929]: <domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 26 21:53:17 user nova-compute[72929]:   <domain>kvm</domain>
Aug 26 21:53:17 user nova-compute[72929]:   <machine>pc-i440fx-6.2</machine>
Aug 26 21:53:17 user nova-compute[72929]:   <arch>x86_64</arch>
Aug 26 21:53:17 user nova-compute[72929]:   <vcpu max='255'/>
Aug 26 21:53:17 user nova-compute[72929]:   <iothreads supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:   <os supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='firmware'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>efi</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:     <loader supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>rom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pflash</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='readonly'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>yes</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='secure'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>no</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </loader>
Aug 26 21:53:17 user nova-compute[72929]:   </os>
Aug 26 21:53:17 user nova-compute[72929]:   <cpu>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-passthrough' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='hostPassthroughMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='maximum' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='maximumMigratable'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>on</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>off</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='host-model' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <vendor>Intel</vendor>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ss'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='vmx'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pcid'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='hypervisor'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arat'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='tsc_adjust'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='umip'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='md-clear'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='arch-capabilities'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='invtsc'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibpb'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='ibrs'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-stibp'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='amd-ssbd'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='rsba'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='require' name='pschange-mc-no'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='erms'/>
Aug 26 21:53:17 user nova-compute[72929]:       <feature policy='disable' name='xsaveopt'/>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:     <mode name='custom' supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>qemu64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>qemu32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>phenom</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>pentium</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>n270</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm64</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>kvm32</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>coreduo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>core2duo</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>athlon</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Westmere</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Snowridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Skylake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>SandyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Penryn</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G5</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G4</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G3</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Opteron_G2</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Opteron_G1</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>IvyBridge</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Icelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Haswell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Rome</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-Milan</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC-IBPB</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>EPYC</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Dhyana</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cooperlake</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>Conroe</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Cascadelake-Server</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-noTSX</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell-IBRS</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='no'>Broadwell</model>
Aug 26 21:53:17 user nova-compute[72929]:       <model usable='yes'>486</model>
Aug 26 21:53:17 user nova-compute[72929]:     </mode>
Aug 26 21:53:17 user nova-compute[72929]:   </cpu>
Aug 26 21:53:17 user nova-compute[72929]:   <memoryBacking supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:     <enum name='sourceType'>
Aug 26 21:53:17 user nova-compute[72929]:       <value>file</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>anonymous</value>
Aug 26 21:53:17 user nova-compute[72929]:       <value>memfd</value>
Aug 26 21:53:17 user nova-compute[72929]:     </enum>
Aug 26 21:53:17 user nova-compute[72929]:   </memoryBacking>
Aug 26 21:53:17 user nova-compute[72929]:   <devices>
Aug 26 21:53:17 user nova-compute[72929]:     <disk supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='diskDevice'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>disk</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cdrom</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>floppy</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>lun</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='bus'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ide</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>fdc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sata</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </disk>
Aug 26 21:53:17 user nova-compute[72929]:     <graphics supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='type'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>sdl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vnc</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>spice</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egl-headless</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </graphics>
Aug 26 21:53:17 user nova-compute[72929]:     <video supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='modelType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>cirrus</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>vmvga</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>qxl</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>none</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>bochs</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>ramfb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </video>
Aug 26 21:53:17 user nova-compute[72929]:     <hostdev supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='mode'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>subsystem</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='startupPolicy'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>default</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>mandatory</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>requisite</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>optional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='subsysType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>usb</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>pci</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>scsi</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='capsType'/>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='pciBackend'/>
Aug 26 21:53:17 user nova-compute[72929]:     </hostdev>
Aug 26 21:53:17 user nova-compute[72929]:     <rng supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtio-non-transitional</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>random</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>egd</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>builtin</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </rng>
Aug 26 21:53:17 user nova-compute[72929]:     <filesystem supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='driverType'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>path</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>handle</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>virtiofs</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </filesystem>
Aug 26 21:53:17 user nova-compute[72929]:     <tpm supported='yes'>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='model'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-tis</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>tpm-crb</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:       <enum name='backendModel'>
Aug 26 21:53:17 user nova-compute[72929]:         <value>passthrough</value>
Aug 26 21:53:17 user nova-compute[72929]:         <value>emulator</value>
Aug 26 21:53:17 user nova-compute[72929]:       </enum>
Aug 26 21:53:17 user nova-compute[72929]:     </tpm>
Aug 26 21:53:17 user nova-compute[72929]:   </devices>
Aug 26 21:53:17 user nova-compute[72929]:   <features>
Aug 26 21:53:17 user nova-compute[72929]:     <gic supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:     <vmcoreinfo supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <genid supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backingStoreInput supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <backup supported='yes'/>
Aug 26 21:53:17 user nova-compute[72929]:     <sev supported='no'/>
Aug 26 21:53:17 user nova-compute[72929]:   </features>
Aug 26 21:53:17 user nova-compute[72929]: </domainCapabilities>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72929) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72929) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72929) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72929) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Checking secure boot support for host arch (x86_64) {{(pid=72929) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 26 21:53:17 user nova-compute[72929]: INFO nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Secure Boot support detected
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] cpu compare xml: <cpu match="exact">
Aug 26 21:53:17 user nova-compute[72929]:   <model>Nehalem</model>
Aug 26 21:53:17 user nova-compute[72929]: </cpu>
Aug 26 21:53:17 user nova-compute[72929]:  {{(pid=72929) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 26 21:53:17 user nova-compute[72929]: INFO nova.virt.node [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Generated node identity 2fc6464f-291c-4428-855f-57fcef178e83
Aug 26 21:53:17 user nova-compute[72929]: INFO nova.virt.node [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Wrote node identity 2fc6464f-291c-4428-855f-57fcef178e83 to /opt/stack/data/nova/compute_id
Aug 26 21:53:17 user nova-compute[72929]: WARNING nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Compute nodes ['2fc6464f-291c-4428-855f-57fcef178e83'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 26 21:53:17 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 26 21:53:17 user nova-compute[72929]: WARNING nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 26 21:53:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:53:17 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:53:17 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Hypervisor/Node resource view: name=user free_ram=10891MB free_disk=25.140151977539062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:53:17 user nova-compute[72929]: WARNING nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] No compute node record for user:2fc6464f-291c-4428-855f-57fcef178e83: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2fc6464f-291c-4428-855f-57fcef178e83 could not be found.
Aug 26 21:53:17 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Compute node record created for user:user with uuid: 2fc6464f-291c-4428-855f-57fcef178e83
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:53:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:53:18 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [req-4ffe66b4-c483-482b-b9da-42e2aae9a210] Created resource provider record via placement API for resource provider with UUID 2fc6464f-291c-4428-855f-57fcef178e83 and name user.
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72929) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 26 21:53:18 user nova-compute[72929]: INFO nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] kernel doesn't support AMD SEV
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Libvirt baseline CPU <cpu>
Aug 26 21:53:18 user nova-compute[72929]:   <arch>x86_64</arch>
Aug 26 21:53:18 user nova-compute[72929]:   <model>Nehalem</model>
Aug 26 21:53:18 user nova-compute[72929]:   <vendor>Intel</vendor>
Aug 26 21:53:18 user nova-compute[72929]:   <topology sockets="6" cores="1" threads="1"/>
Aug 26 21:53:18 user nova-compute[72929]: </cpu>
Aug 26 21:53:18 user nova-compute[72929]:  {{(pid=72929) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Updated inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Updating resource provider 2fc6464f-291c-4428-855f-57fcef178e83 generation from 0 to 1 during operation: update_inventory {{(pid=72929) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Updating resource provider 2fc6464f-291c-4428-855f-57fcef178e83 generation from 1 to 2 during operation: update_traits {{(pid=72929) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.service [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Creating RPC server for service compute {{(pid=72929) start /opt/stack/nova/nova/service.py:182}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.service [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Join ServiceGroup membership for this service compute {{(pid=72929) start /opt/stack/nova/nova/service.py:199}}
Aug 26 21:53:18 user nova-compute[72929]: DEBUG nova.servicegroup.drivers.db [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72929) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 26 21:53:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_power_states {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:53:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:54:09 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:54:09 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=10266MB free_disk=25.043861389160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:54:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:55:09 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:55:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:55:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:55:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=10209MB free_disk=25.090347290039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:55:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:56:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:56:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=10219MB free_disk=24.87417221069336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:56:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:56:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:56:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:56:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:56:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:56:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:56:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:57:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=9449MB free_disk=24.898387908935547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:57:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:11 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:57:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:57:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:57:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 21:57:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:22 user nova-compute[72929]: INFO nova.compute.claims [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Claim successful on node user
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:22 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.220s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:23 user nova-compute[72929]: INFO nova.compute.claims [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Claim successful on node user
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Creating image(s)
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG nova.policy [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1f096d5ce9547a09fdb841fc10e89f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd082ef6806524abc8e771889da65faf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG nova.policy [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2dac68027a44a09a4deadab28f2981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6d14fc09c246779e46e7c816370a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:24 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Creating image(s)
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "/opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "/opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "/opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.part --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG nova.virt.images [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] 004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3 was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.part /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.part /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.converted" returned: 0 in 0.134s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.150s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:24 user nova-compute[72929]: INFO oslo.privsep.daemon [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa8cf_zrx/privsep.sock']
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.431s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:24 user sudo[82444]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa8cf_zrx/privsep.sock
Aug 26 21:57:24 user sudo[82444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:25 user nova-compute[72929]: INFO nova.compute.claims [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Claim successful on node user
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.067s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:25 user nova-compute[72929]: INFO nova.compute.claims [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Claim successful on node user
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.network.neutron [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:26 user sudo[82444]: pam_unix(sudo:session): session closed for user root
Aug 26 21:57:26 user nova-compute[72929]: INFO oslo.privsep.daemon [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Spawned new privsep daemon via rootwrap
Aug 26 21:57:26 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 21:57:26 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 21:57:26 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 26 21:57:26 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82522
Aug 26 21:57:26 user nova-compute[72929]: WARNING oslo_privsep.priv_context [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] privsep daemon already running
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Creating image(s)
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.network.neutron [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.213s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.policy [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2dac68027a44a09a4deadab28f2981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6d14fc09c246779e46e7c816370a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.302s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Creating image(s)
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.policy [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ef1bea627245e29428b442787db7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a593fe9fb7a442f08880ecd2fab42df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.206s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Successfully created port: 27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk 1073741824" returned: 0 in 0.070s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.277s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.278s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.281s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk 1073741824" returned: 0 in 0.116s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.543s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Successfully created port: d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:27 user nova-compute[72929]: INFO nova.compute.claims [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Claim successful on node user
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Cannot resize image /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Ensure instance console log exists: /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.271s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk 1073741824" returned: 0 in 0.049s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.616s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Cannot resize image /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Ensure instance console log exists: /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk 1073741824" returned: 0 in 0.060s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Cannot resize image /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Ensure instance console log exists: /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Cannot resize image /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Ensure instance console log exists: /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Creating image(s)
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG nova.policy [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf32662e1a4e466781518d4fdd63cb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dd3139d0af4e319ee02bff3155650b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.213s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk 1073741824" returned: 0 in 0.121s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.339s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Cannot resize image /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Ensure instance console log exists: /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Successfully created port: 73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Successfully created port: 6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Successfully updated port: d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Successfully updated port: 27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquired lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-changed-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Refreshing instance network info cache due to event network-changed-d4498661-cc5a-4569-8826-1dec471eda12. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:32 user nova-compute[72929]: DEBUG nova.compute.manager [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-changed-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:32 user nova-compute[72929]: DEBUG nova.compute.manager [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Refreshing instance network info cache due to event network-changed-27f412b2-a4dd-4619-987f-f03a90ded0b1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] Acquiring lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:32 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Successfully created port: b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance network_info: |[{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Refreshing network info cache for port d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Start _get_guest_xml network_info=[{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:33 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:33 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-99622531',display_name='tempest-ServerRescueNegativeTestJSON-server-99622531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-99622531',id=1,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-cdrtnr48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:23Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=e17322c4-5841-452d-b4f1-f67f85a9827a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'pci_devices' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updating instance_info_cache with network_info: [{"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:33 user nova-compute[72929]:   <uuid>e17322c4-5841-452d-b4f1-f67f85a9827a</uuid>
Aug 26 21:57:33 user nova-compute[72929]:   <name>instance-00000001</name>
Aug 26 21:57:33 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:33 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:33 user nova-compute[72929]:   <metadata>
Aug 26 21:57:33 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:33 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-99622531</nova:name>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:33</nova:creationTime>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:33 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:33 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:user uuid="6c2dac68027a44a09a4deadab28f2981">tempest-ServerRescueNegativeTestJSON-26026282-project-member</nova:user>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:project uuid="4e6d14fc09c246779e46e7c816370a1c">tempest-ServerRescueNegativeTestJSON-26026282</nova:project>
Aug 26 21:57:33 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:port uuid="d4498661-cc5a-4569-8826-1dec471eda12">
Aug 26 21:57:33 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 21:57:33 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:33 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:33 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:33 user nova-compute[72929]:   </metadata>
Aug 26 21:57:33 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:33 user nova-compute[72929]:     <system>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="serial">e17322c4-5841-452d-b4f1-f67f85a9827a</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="uuid">e17322c4-5841-452d-b4f1-f67f85a9827a</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:33 user nova-compute[72929]:     </system>
Aug 26 21:57:33 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:33 user nova-compute[72929]:   <os>
Aug 26 21:57:33 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:33 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:33 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:33 user nova-compute[72929]:   </os>
Aug 26 21:57:33 user nova-compute[72929]:   <features>
Aug 26 21:57:33 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:33 user nova-compute[72929]:     <apic/>
Aug 26 21:57:33 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:33 user nova-compute[72929]:   </features>
Aug 26 21:57:33 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:33 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:33 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:33 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:33 user nova-compute[72929]:   </clock>
Aug 26 21:57:33 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:33 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:33 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:33 user nova-compute[72929]:   </cpu>
Aug 26 21:57:33 user nova-compute[72929]:   <devices>
Aug 26 21:57:33 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:33 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:33 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk"/>
Aug 26 21:57:33 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:57:33 user nova-compute[72929]:     </disk>
Aug 26 21:57:33 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:33 user nova-compute[72929]:       <mac address="fa:16:3e:2c:9a:a6"/>
Aug 26 21:57:33 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:33 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:33 user nova-compute[72929]:       <target dev="tapd4498661-cc"/>
Aug 26 21:57:33 user nova-compute[72929]:     </interface>
Aug 26 21:57:33 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:33 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/console.log" append="off"/>
Aug 26 21:57:33 user nova-compute[72929]:     </serial>
Aug 26 21:57:33 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:33 user nova-compute[72929]:     <video>
Aug 26 21:57:33 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:33 user nova-compute[72929]:     </video>
Aug 26 21:57:33 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:33 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:33 user nova-compute[72929]:     </rng>
Aug 26 21:57:33 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:33 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:33 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:33 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:33 user nova-compute[72929]:   </devices>
Aug 26 21:57:33 user nova-compute[72929]: </domain>
Aug 26 21:57:33 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-99622531',display_name='tempest-ServerRescueNegativeTestJSON-server-99622531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-99622531',id=1,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-cdrtnr48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:23Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=e17322c4-5841-452d-b4f1-f67f85a9827a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG os_vif [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Releasing lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Instance network_info: |[{"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Created schema index Interface.name {{(pid=72929) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Created schema index Port.name {{(pid=72929) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Created schema index Bridge.name {{(pid=72929) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] Acquired lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Refreshing network info cache for port 27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Start _get_guest_xml network_info=[{"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [POLLOUT] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:33 user nova-compute[72929]: INFO oslo.privsep.daemon [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_3t4tqku/privsep.sock']
Aug 26 21:57:33 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:33 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:33 user sudo[82620]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_3t4tqku/privsep.sock
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:33 user sudo[82620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-845530859',display_name='tempest-DeleteServersTestJSON-server-845530859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-845530859',id=2,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d082ef6806524abc8e771889da65faf7',ramdisk_id='',reservation_id='r-uiy3zyaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-963247611',owner_user_name='tempest-DeleteServersTestJSON-963247611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:24Z,user_data=None,user_id='e1f096d5ce9547a09fdb841fc10e89f1',uuid=32f5db95-9356-4feb-9dd8-44727cebdde0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Converting VIF {"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lazy-loading 'pci_devices' on Instance uuid 32f5db95-9356-4feb-9dd8-44727cebdde0 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:33 user nova-compute[72929]:   <uuid>32f5db95-9356-4feb-9dd8-44727cebdde0</uuid>
Aug 26 21:57:33 user nova-compute[72929]:   <name>instance-00000002</name>
Aug 26 21:57:33 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:33 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:33 user nova-compute[72929]:   <metadata>
Aug 26 21:57:33 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:33 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:name>tempest-DeleteServersTestJSON-server-845530859</nova:name>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:33</nova:creationTime>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:33 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:33 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:user uuid="e1f096d5ce9547a09fdb841fc10e89f1">tempest-DeleteServersTestJSON-963247611-project-member</nova:user>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:project uuid="d082ef6806524abc8e771889da65faf7">tempest-DeleteServersTestJSON-963247611</nova:project>
Aug 26 21:57:33 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:57:33 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:33 user nova-compute[72929]:         <nova:port uuid="27f412b2-a4dd-4619-987f-f03a90ded0b1">
Aug 26 21:57:33 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 21:57:33 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:33 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:33 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:33 user nova-compute[72929]:   </metadata>
Aug 26 21:57:33 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:33 user nova-compute[72929]:     <system>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="serial">32f5db95-9356-4feb-9dd8-44727cebdde0</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="uuid">32f5db95-9356-4feb-9dd8-44727cebdde0</entry>
Aug 26 21:57:33 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:33 user nova-compute[72929]:     </system>
Aug 26 21:57:33 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:33 user nova-compute[72929]:   <os>
Aug 26 21:57:33 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:33 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:33 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:33 user nova-compute[72929]:   </os>
Aug 26 21:57:33 user nova-compute[72929]:   <features>
Aug 26 21:57:33 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:33 user nova-compute[72929]:     <apic/>
Aug 26 21:57:33 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:33 user nova-compute[72929]:   </features>
Aug 26 21:57:33 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:33 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:33 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:33 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:33 user nova-compute[72929]:   </clock>
Aug 26 21:57:33 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:33 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:33 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:33 user nova-compute[72929]:   </cpu>
Aug 26 21:57:33 user nova-compute[72929]:   <devices>
Aug 26 21:57:33 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:33 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:33 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk"/>
Aug 26 21:57:33 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:57:33 user nova-compute[72929]:     </disk>
Aug 26 21:57:33 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:33 user nova-compute[72929]:       <mac address="fa:16:3e:9f:97:5d"/>
Aug 26 21:57:33 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:33 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:33 user nova-compute[72929]:       <target dev="tap27f412b2-a4"/>
Aug 26 21:57:33 user nova-compute[72929]:     </interface>
Aug 26 21:57:33 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:33 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/console.log" append="off"/>
Aug 26 21:57:33 user nova-compute[72929]:     </serial>
Aug 26 21:57:33 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:33 user nova-compute[72929]:     <video>
Aug 26 21:57:33 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:33 user nova-compute[72929]:     </video>
Aug 26 21:57:33 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:33 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:33 user nova-compute[72929]:     </rng>
Aug 26 21:57:33 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:33 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:33 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:33 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:33 user nova-compute[72929]:   </devices>
Aug 26 21:57:33 user nova-compute[72929]: </domain>
Aug 26 21:57:33 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-845530859',display_name='tempest-DeleteServersTestJSON-server-845530859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-845530859',id=2,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d082ef6806524abc8e771889da65faf7',ramdisk_id='',reservation_id='r-uiy3zyaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-963247611',owner_user_name='tempest-DeleteServersTestJSON-963247611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:24Z,user_data=None,user_id='e1f096d5ce9547a09fdb841fc10e89f1',uuid=32f5db95-9356-4feb-9dd8-44727cebdde0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Converting VIF {"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG os_vif [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Successfully updated port: 73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquired lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-changed-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Refreshing instance network info cache due to event network-changed-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] Acquiring lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Successfully updated port: 6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-changed-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Refreshing instance network info cache due to event network-changed-6445469e-029a-41c3-8079-da27e416b226. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] Acquiring lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updating instance_info_cache with network_info: [{"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Releasing lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Instance network_info: |[{"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] Acquired lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Refreshing network info cache for port 73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Start _get_guest_xml network_info=[{"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:34 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:34 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1670765526',display_name='tempest-AttachVolumeNegativeTest-server-1670765526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1670765526',id=4,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDedJBuea2/4gQeCDQ92YPRu6qlFW0csdZ0ev5xK1ypfq8x+hSFzfiTW0HnKKlGiVQFj1v0605uzJGN+II14+GfMWSwwmZSsc0AEus8fFLRasmjI9/0GzzUQeqYPWytQjg==',key_name='tempest-keypair-1045925128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-h98jjznj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=ef9f239c-6d27-46ed-ba08-bc01a0b4dc51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.objects.instance [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'pci_devices' on Instance uuid ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:34 user nova-compute[72929]:   <uuid>ef9f239c-6d27-46ed-ba08-bc01a0b4dc51</uuid>
Aug 26 21:57:34 user nova-compute[72929]:   <name>instance-00000004</name>
Aug 26 21:57:34 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:34 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:34 user nova-compute[72929]:   <metadata>
Aug 26 21:57:34 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:34 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:34 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1670765526</nova:name>
Aug 26 21:57:34 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:34</nova:creationTime>
Aug 26 21:57:34 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:34 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:34 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:34 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:user uuid="64ef1bea627245e29428b442787db7b7">tempest-AttachVolumeNegativeTest-600362177-project-member</nova:user>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:project uuid="a593fe9fb7a442f08880ecd2fab42df6">tempest-AttachVolumeNegativeTest-600362177</nova:project>
Aug 26 21:57:34 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:34 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:57:34 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:34 user nova-compute[72929]:         <nova:port uuid="73b207d0-01f3-48c1-b5b1-2e5cd6bc569a">
Aug 26 21:57:34 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 21:57:34 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:34 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:34 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:34 user nova-compute[72929]:   </metadata>
Aug 26 21:57:34 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:34 user nova-compute[72929]:     <system>
Aug 26 21:57:34 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:34 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:34 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:34 user nova-compute[72929]:       <entry name="serial">ef9f239c-6d27-46ed-ba08-bc01a0b4dc51</entry>
Aug 26 21:57:34 user nova-compute[72929]:       <entry name="uuid">ef9f239c-6d27-46ed-ba08-bc01a0b4dc51</entry>
Aug 26 21:57:34 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:34 user nova-compute[72929]:     </system>
Aug 26 21:57:34 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:34 user nova-compute[72929]:   <os>
Aug 26 21:57:34 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:34 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:34 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:34 user nova-compute[72929]:   </os>
Aug 26 21:57:34 user nova-compute[72929]:   <features>
Aug 26 21:57:34 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:34 user nova-compute[72929]:     <apic/>
Aug 26 21:57:34 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:34 user nova-compute[72929]:   </features>
Aug 26 21:57:34 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:34 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:34 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:34 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:34 user nova-compute[72929]:   </clock>
Aug 26 21:57:34 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:34 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:34 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:34 user nova-compute[72929]:   </cpu>
Aug 26 21:57:34 user nova-compute[72929]:   <devices>
Aug 26 21:57:34 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:34 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:34 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk"/>
Aug 26 21:57:34 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:57:34 user nova-compute[72929]:     </disk>
Aug 26 21:57:34 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:34 user nova-compute[72929]:       <mac address="fa:16:3e:6c:41:e5"/>
Aug 26 21:57:34 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:34 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:34 user nova-compute[72929]:       <target dev="tap73b207d0-01"/>
Aug 26 21:57:34 user nova-compute[72929]:     </interface>
Aug 26 21:57:34 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:34 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/console.log" append="off"/>
Aug 26 21:57:34 user nova-compute[72929]:     </serial>
Aug 26 21:57:34 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:34 user nova-compute[72929]:     <video>
Aug 26 21:57:34 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:34 user nova-compute[72929]:     </video>
Aug 26 21:57:34 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:34 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:34 user nova-compute[72929]:     </rng>
Aug 26 21:57:34 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:34 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:34 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:34 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:34 user nova-compute[72929]:   </devices>
Aug 26 21:57:34 user nova-compute[72929]: </domain>
Aug 26 21:57:34 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1670765526',display_name='tempest-AttachVolumeNegativeTest-server-1670765526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1670765526',id=4,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDedJBuea2/4gQeCDQ92YPRu6qlFW0csdZ0ev5xK1ypfq8x+hSFzfiTW0HnKKlGiVQFj1v0605uzJGN+II14+GfMWSwwmZSsc0AEus8fFLRasmjI9/0GzzUQeqYPWytQjg==',key_name='tempest-keypair-1045925128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-h98jjznj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=ef9f239c-6d27-46ed-ba08-bc01a0b4dc51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG os_vif [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updated VIF entry in instance network info cache for port d4498661-cc5a-4569-8826-1dec471eda12. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:57:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab689362-18cc-4dc6-aac7-b00cbae0fc3f req-f9c5cdc0-d4c3-49af-8a43-be7626a1a86d service nova] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updated VIF entry in instance network info cache for port 27f412b2-a4dd-4619-987f-f03a90ded0b1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updating instance_info_cache with network_info: [{"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9c1d6131-27d9-4fec-a75b-daef09a877c5 req-949f62e8-131b-4b91-8c2f-613941542f1e service nova] Releasing lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:35 user sudo[82620]: pam_unix(sudo:session): session closed for user root
Aug 26 21:57:35 user nova-compute[72929]: INFO oslo.privsep.daemon [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Spawned new privsep daemon via rootwrap
Aug 26 21:57:35 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 21:57:35 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 21:57:35 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 26 21:57:35 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82633
Aug 26 21:57:35 user nova-compute[72929]: WARNING oslo_privsep.priv_context [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] privsep daemon already running
Aug 26 21:57:35 user nova-compute[72929]: WARNING oslo_privsep.priv_context [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] privsep daemon already running
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updating instance_info_cache with network_info: [{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance network_info: |[{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] Acquired lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Refreshing network info cache for port 6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Start _get_guest_xml network_info=[{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:35 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:35 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-284762778',display_name='tempest-ServerRescueNegativeTestJSON-server-284762778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-284762778',id=3,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-ncm66cmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:26Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=2f582511-ae2c-47e3-aa26-86e173891e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.objects.instance [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:35 user nova-compute[72929]:   <uuid>2f582511-ae2c-47e3-aa26-86e173891e56</uuid>
Aug 26 21:57:35 user nova-compute[72929]:   <name>instance-00000003</name>
Aug 26 21:57:35 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:35 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:35 user nova-compute[72929]:   <metadata>
Aug 26 21:57:35 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:35 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:35 user nova-compute[72929]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-284762778</nova:name>
Aug 26 21:57:35 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:35</nova:creationTime>
Aug 26 21:57:35 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:35 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:35 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:35 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:user uuid="6c2dac68027a44a09a4deadab28f2981">tempest-ServerRescueNegativeTestJSON-26026282-project-member</nova:user>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:project uuid="4e6d14fc09c246779e46e7c816370a1c">tempest-ServerRescueNegativeTestJSON-26026282</nova:project>
Aug 26 21:57:35 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:35 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:57:35 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:35 user nova-compute[72929]:         <nova:port uuid="6445469e-029a-41c3-8079-da27e416b226">
Aug 26 21:57:35 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 21:57:35 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:35 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:35 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:35 user nova-compute[72929]:   </metadata>
Aug 26 21:57:35 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:35 user nova-compute[72929]:     <system>
Aug 26 21:57:35 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:35 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:35 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:35 user nova-compute[72929]:       <entry name="serial">2f582511-ae2c-47e3-aa26-86e173891e56</entry>
Aug 26 21:57:35 user nova-compute[72929]:       <entry name="uuid">2f582511-ae2c-47e3-aa26-86e173891e56</entry>
Aug 26 21:57:35 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:35 user nova-compute[72929]:     </system>
Aug 26 21:57:35 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:35 user nova-compute[72929]:   <os>
Aug 26 21:57:35 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:35 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:35 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:35 user nova-compute[72929]:   </os>
Aug 26 21:57:35 user nova-compute[72929]:   <features>
Aug 26 21:57:35 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:35 user nova-compute[72929]:     <apic/>
Aug 26 21:57:35 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:35 user nova-compute[72929]:   </features>
Aug 26 21:57:35 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:35 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:35 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:35 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:35 user nova-compute[72929]:   </clock>
Aug 26 21:57:35 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:35 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:35 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:35 user nova-compute[72929]:   </cpu>
Aug 26 21:57:35 user nova-compute[72929]:   <devices>
Aug 26 21:57:35 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:35 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:35 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk"/>
Aug 26 21:57:35 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:57:35 user nova-compute[72929]:     </disk>
Aug 26 21:57:35 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:35 user nova-compute[72929]:       <mac address="fa:16:3e:38:70:ac"/>
Aug 26 21:57:35 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:35 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:35 user nova-compute[72929]:       <target dev="tap6445469e-02"/>
Aug 26 21:57:35 user nova-compute[72929]:     </interface>
Aug 26 21:57:35 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:35 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/console.log" append="off"/>
Aug 26 21:57:35 user nova-compute[72929]:     </serial>
Aug 26 21:57:35 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:35 user nova-compute[72929]:     <video>
Aug 26 21:57:35 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:35 user nova-compute[72929]:     </video>
Aug 26 21:57:35 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:35 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:35 user nova-compute[72929]:     </rng>
Aug 26 21:57:35 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:35 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:35 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:35 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:35 user nova-compute[72929]:   </devices>
Aug 26 21:57:35 user nova-compute[72929]: </domain>
Aug 26 21:57:35 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-284762778',display_name='tempest-ServerRescueNegativeTestJSON-server-284762778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-284762778',id=3,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-ncm66cmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:26Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=2f582511-ae2c-47e3-aa26-86e173891e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG os_vif [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Successfully updated port: b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing instance network info cache due to event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73b207d0-01, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73b207d0-01, col_values=(('external_ids', {'iface-id': '73b207d0-01f3-48c1-b5b1-2e5cd6bc569a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:41:e5', 'vm-uuid': 'ef9f239c-6d27-46ed-ba08-bc01a0b4dc51'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: INFO os_vif [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01')
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27f412b2-a4, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap27f412b2-a4, col_values=(('external_ids', {'iface-id': '27f412b2-a4dd-4619-987f-f03a90ded0b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:97:5d', 'vm-uuid': '32f5db95-9356-4feb-9dd8-44727cebdde0'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: INFO os_vif [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4')
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6445469e-02, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6445469e-02, col_values=(('external_ids', {'iface-id': '6445469e-029a-41c3-8079-da27e416b226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:70:ac', 'vm-uuid': '2f582511-ae2c-47e3-aa26-86e173891e56'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: INFO os_vif [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02')
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4498661-cc, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4498661-cc, col_values=(('external_ids', {'iface-id': 'd4498661-cc5a-4569-8826-1dec471eda12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:9a:a6', 'vm-uuid': 'e17322c4-5841-452d-b4f1-f67f85a9827a'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: INFO os_vif [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc')
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:6c:41:e5, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] No VIF found with MAC fa:16:3e:9f:97:5d, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:38:70:ac, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:2c:9a:a6, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance network_info: |[{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Start _get_guest_xml network_info=[{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:36 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:36 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584320566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584320566',id=5,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFaPTVM4OFRu1DthBEJTVU2EIFqlrkWnEW06IquF3BgEMnN3jf16w1C+hlgxb4vW3PW0MZWYJRsFdtZHXX3UIpkEai0Zlf+C0WaylyFHaJFyimjpZ4ei+spTEGUz+6FQ==',key_name='tempest-keypair-144813694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-6z0hzvy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=925086ad-8a40-40e1-a537-a00923a0dd3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'pci_devices' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updated VIF entry in instance network info cache for port 73b207d0-01f3-48c1-b5b1-2e5cd6bc569a. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updating instance_info_cache with network_info: [{"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:36 user nova-compute[72929]:   <uuid>925086ad-8a40-40e1-a537-a00923a0dd3f</uuid>
Aug 26 21:57:36 user nova-compute[72929]:   <name>instance-00000005</name>
Aug 26 21:57:36 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:36 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:36 user nova-compute[72929]:   <metadata>
Aug 26 21:57:36 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:36 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:36 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-584320566</nova:name>
Aug 26 21:57:36 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:36</nova:creationTime>
Aug 26 21:57:36 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:36 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:36 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:36 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:user uuid="cf32662e1a4e466781518d4fdd63cb76">tempest-AttachVolumeShelveTestJSON-1476482184-project-member</nova:user>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:project uuid="22dd3139d0af4e319ee02bff3155650b">tempest-AttachVolumeShelveTestJSON-1476482184</nova:project>
Aug 26 21:57:36 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:36 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:57:36 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:36 user nova-compute[72929]:         <nova:port uuid="b33f29b7-cf46-4503-ab4e-b067767186ed">
Aug 26 21:57:36 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 21:57:36 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:36 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:36 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:36 user nova-compute[72929]:   </metadata>
Aug 26 21:57:36 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:36 user nova-compute[72929]:     <system>
Aug 26 21:57:36 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:36 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:36 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:36 user nova-compute[72929]:       <entry name="serial">925086ad-8a40-40e1-a537-a00923a0dd3f</entry>
Aug 26 21:57:36 user nova-compute[72929]:       <entry name="uuid">925086ad-8a40-40e1-a537-a00923a0dd3f</entry>
Aug 26 21:57:36 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:36 user nova-compute[72929]:     </system>
Aug 26 21:57:36 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:36 user nova-compute[72929]:   <os>
Aug 26 21:57:36 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:36 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:36 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:36 user nova-compute[72929]:   </os>
Aug 26 21:57:36 user nova-compute[72929]:   <features>
Aug 26 21:57:36 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:36 user nova-compute[72929]:     <apic/>
Aug 26 21:57:36 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:36 user nova-compute[72929]:   </features>
Aug 26 21:57:36 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:36 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:36 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:36 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:36 user nova-compute[72929]:   </clock>
Aug 26 21:57:36 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:36 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:36 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:36 user nova-compute[72929]:   </cpu>
Aug 26 21:57:36 user nova-compute[72929]:   <devices>
Aug 26 21:57:36 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:36 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:36 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk"/>
Aug 26 21:57:36 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:57:36 user nova-compute[72929]:     </disk>
Aug 26 21:57:36 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:36 user nova-compute[72929]:       <mac address="fa:16:3e:83:35:e9"/>
Aug 26 21:57:36 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:36 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:36 user nova-compute[72929]:       <target dev="tapb33f29b7-cf"/>
Aug 26 21:57:36 user nova-compute[72929]:     </interface>
Aug 26 21:57:36 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:36 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/console.log" append="off"/>
Aug 26 21:57:36 user nova-compute[72929]:     </serial>
Aug 26 21:57:36 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:36 user nova-compute[72929]:     <video>
Aug 26 21:57:36 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:36 user nova-compute[72929]:     </video>
Aug 26 21:57:36 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:36 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:36 user nova-compute[72929]:     </rng>
Aug 26 21:57:36 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:36 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:36 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:36 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:36 user nova-compute[72929]:   </devices>
Aug 26 21:57:36 user nova-compute[72929]: </domain>
Aug 26 21:57:36 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584320566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584320566',id=5,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFaPTVM4OFRu1DthBEJTVU2EIFqlrkWnEW06IquF3BgEMnN3jf16w1C+hlgxb4vW3PW0MZWYJRsFdtZHXX3UIpkEai0Zlf+C0WaylyFHaJFyimjpZ4ei+spTEGUz+6FQ==',key_name='tempest-keypair-144813694',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-6z0hzvy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=925086ad-8a40-40e1-a537-a00923a0dd3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG os_vif [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-40ce8561-dae4-42d8-adb6-3bfacd63a0c4 req-95b8d9b6-86b2-4265-8ff9-cd622d7ab3ce service nova] Releasing lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb33f29b7-cf, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb33f29b7-cf, col_values=(('external_ids', {'iface-id': 'b33f29b7-cf46-4503-ab4e-b067767186ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:35:e9', 'vm-uuid': '925086ad-8a40-40e1-a537-a00923a0dd3f'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:36 user nova-compute[72929]: INFO os_vif [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf')
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No VIF found with MAC fa:16:3e:83:35:e9, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updated VIF entry in instance network info cache for port 6445469e-029a-41c3-8079-da27e416b226. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:57:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updating instance_info_cache with network_info: [{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e046d7aa-9fc5-477a-bdf6-6a67ec3fd2fb req-5b6c89de-827b-491a-b7cd-c9c6cc4187fd service nova] Releasing lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:38 user nova-compute[72929]: DEBUG nova.network.neutron [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updated VIF entry in instance network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:57:38 user nova-compute[72929]: DEBUG nova.network.neutron [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71a73acc-1dc3-4573-9719-28d3593066fe req-2c46b232-04eb-4056-8184-4762e58cda56 service nova] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:57:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.0434713, e17322c4-5841-452d-b4f1-f67f85a9827a => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Resumed (Lifecycle Event)
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.claims [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Claim successful on node user
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Instance spawned successfully.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance spawned successfully.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.0437622, e17322c4-5841-452d-b4f1-f67f85a9827a => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Started (Lifecycle Event)
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance spawned successfully.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Instance spawned successfully.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Took 22.23 seconds to spawn the instance on the hypervisor.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Took 23.04 seconds to spawn the instance on the hypervisor.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.0438614, 32f5db95-9356-4feb-9dd8-44727cebdde0 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] VM Resumed (Lifecycle Event)
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance spawned successfully.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Took 23.87 seconds to build instance.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.044971, 32f5db95-9356-4feb-9dd8-44727cebdde0 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] VM Started (Lifecycle Event)
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Took 19.92 seconds to spawn the instance on the hypervisor.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3732df8f-ddc4-4a99-84d5-69a0e60eba83 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.132s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Took 20.47 seconds to spawn the instance on the hypervisor.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Took 24.38 seconds to build instance.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0a6b6a59-e770-4b08-9a46-16d8722eb840 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.618s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:46 user nova-compute[72929]: INFO nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Took 18.49 seconds to spawn the instance on the hypervisor.
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:46 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.2849092, 2f582511-ae2c-47e3-aa26-86e173891e56 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] VM Resumed (Lifecycle Event)
Aug 26 21:57:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.28507, 2f582511-ae2c-47e3-aa26-86e173891e56 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] VM Started (Lifecycle Event)
Aug 26 21:57:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Took 21.63 seconds to build instance.
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Took 20.11 seconds to build instance.
Aug 26 21:57:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.277s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.071s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-95fbfbe2-ef82-443d-9e81-e00f3d9d31f4 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.844s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.claims [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Claim successful on node user
Aug 26 21:57:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b056082-b989-4255-b372-18235f68b02a tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.404s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Took 22.22 seconds to build instance.
Aug 26 21:57:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-845395d3-bba6-4647-ba49-3c68f088203a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.363s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.2851942, ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] VM Resumed (Lifecycle Event)
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:47 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.3046925, ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] VM Started (Lifecycle Event)
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.4720886, 925086ad-8a40-40e1-a537-a00923a0dd3f => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] VM Resumed (Lifecycle Event)
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087066.4735749, 925086ad-8a40-40e1-a537-a00923a0dd3f => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:57:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] VM Started (Lifecycle Event)
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.policy [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6509530943dc49dc897e975e0695292f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1296783b514e0a93a7d6b8d464335c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Creating image(s)
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "/opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "/opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "/opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.062s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:57:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.316s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG nova.policy [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '656e0f45e77346aca4eae789ee358e59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0859e779cef94ade81b7cab93675a248', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:57:49 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Creating image(s)
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "/opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "/opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "/opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "18e991994d37a8ecae21c71e867a657c9a4f70b4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "18e991994d37a8ecae21c71e867a657c9a4f70b4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.008s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.534s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk 1073741824" returned: 0 in 0.096s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.644s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.995s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.part --force-share --output=json" returned: 0 in 0.398s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG nova.virt.images [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] fdb76caf-b4f8-48f8-894b-47c48ce1d283 was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.part /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Cannot resize image /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Ensure instance console log exists: /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.part /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.converted" returned: 0 in 0.342s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4.converted --force-share --output=json" returned: 0 in 0.305s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "18e991994d37a8ecae21c71e867a657c9a4f70b4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.060s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Successfully created port: 6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 --force-share --output=json" returned: 0 in 0.270s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "18e991994d37a8ecae21c71e867a657c9a4f70b4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "18e991994d37a8ecae21c71e867a657c9a4f70b4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 --force-share --output=json" returned: 0 in 0.316s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4,backing_fmt=raw /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4,backing_fmt=raw /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk 1073741824" returned: 0 in 0.069s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "18e991994d37a8ecae21c71e867a657c9a4f70b4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.394s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 --force-share --output=json" returned: 0 in 0.335s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Checking if we can resize image /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Cannot resize image /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Ensure instance console log exists: /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:57:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Successfully created port: da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:57:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Successfully updated port: 6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquired lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-changed-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Refreshing instance network info cache due to event network-changed-6625c989-7fe6-4039-88a7-1d09eb866607. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] Acquiring lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updating instance_info_cache with network_info: [{"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Releasing lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Instance network_info: |[{"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] Acquired lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Refreshing network info cache for port 6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Start _get_guest_xml network_info=[{"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:56 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:56 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-993392427',display_name='tempest-VolumesAdminNegativeTest-server-993392427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-993392427',id=6,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl+Fha5jyKyHHMzP106FLQHrD0ktTRKjpRKvN9MXtqkrzg/dKQqUWTH2zASQV7T0XX0Co/wUktjyuJeFKrrqUsbS3RLFUWefUa6xf4DEfsXuDrZWwkLDTNn4LpDuHzHww==',key_name='tempest-keypair-1029206930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1296783b514e0a93a7d6b8d464335c',ramdisk_id='',reservation_id='r-uvnmumf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1477467048',owner_user_name='tempest-VolumesAdminNegativeTest-1477467048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6509530943dc49dc897e975e0695292f',uuid=90e97032-f5f1-412a-b74a-50528262e6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converting VIF {"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'pci_devices' on Instance uuid 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Successfully updated port: da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-changed-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Refreshing instance network info cache due to event network-changed-da9d466b-10f9-415a-b4d5-85a26b55fd98. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] Acquiring lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] Acquired lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Refreshing network info cache for port da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:56 user nova-compute[72929]:   <uuid>90e97032-f5f1-412a-b74a-50528262e6d8</uuid>
Aug 26 21:57:56 user nova-compute[72929]:   <name>instance-00000006</name>
Aug 26 21:57:56 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:56 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:56 user nova-compute[72929]:   <metadata>
Aug 26 21:57:56 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:56 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:56 user nova-compute[72929]:       <nova:name>tempest-VolumesAdminNegativeTest-server-993392427</nova:name>
Aug 26 21:57:56 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:56</nova:creationTime>
Aug 26 21:57:56 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:56 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:56 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:56 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:user uuid="6509530943dc49dc897e975e0695292f">tempest-VolumesAdminNegativeTest-1477467048-project-member</nova:user>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:project uuid="9b1296783b514e0a93a7d6b8d464335c">tempest-VolumesAdminNegativeTest-1477467048</nova:project>
Aug 26 21:57:56 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:56 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:57:56 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:56 user nova-compute[72929]:         <nova:port uuid="6625c989-7fe6-4039-88a7-1d09eb866607">
Aug 26 21:57:56 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:57:56 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:56 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:56 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:56 user nova-compute[72929]:   </metadata>
Aug 26 21:57:56 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:56 user nova-compute[72929]:     <system>
Aug 26 21:57:56 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:56 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:56 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:56 user nova-compute[72929]:       <entry name="serial">90e97032-f5f1-412a-b74a-50528262e6d8</entry>
Aug 26 21:57:56 user nova-compute[72929]:       <entry name="uuid">90e97032-f5f1-412a-b74a-50528262e6d8</entry>
Aug 26 21:57:56 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:56 user nova-compute[72929]:     </system>
Aug 26 21:57:56 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:56 user nova-compute[72929]:   <os>
Aug 26 21:57:56 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:56 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:56 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:56 user nova-compute[72929]:   </os>
Aug 26 21:57:56 user nova-compute[72929]:   <features>
Aug 26 21:57:56 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:56 user nova-compute[72929]:     <apic/>
Aug 26 21:57:56 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:56 user nova-compute[72929]:   </features>
Aug 26 21:57:56 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:56 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:56 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:56 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:56 user nova-compute[72929]:   </clock>
Aug 26 21:57:56 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:56 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:56 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:56 user nova-compute[72929]:   </cpu>
Aug 26 21:57:56 user nova-compute[72929]:   <devices>
Aug 26 21:57:56 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:56 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:56 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk"/>
Aug 26 21:57:56 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:57:56 user nova-compute[72929]:     </disk>
Aug 26 21:57:56 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:56 user nova-compute[72929]:       <mac address="fa:16:3e:97:68:8b"/>
Aug 26 21:57:56 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:56 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:56 user nova-compute[72929]:       <target dev="tap6625c989-7f"/>
Aug 26 21:57:56 user nova-compute[72929]:     </interface>
Aug 26 21:57:56 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:56 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/console.log" append="off"/>
Aug 26 21:57:56 user nova-compute[72929]:     </serial>
Aug 26 21:57:56 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:56 user nova-compute[72929]:     <video>
Aug 26 21:57:56 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:56 user nova-compute[72929]:     </video>
Aug 26 21:57:56 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:56 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:56 user nova-compute[72929]:     </rng>
Aug 26 21:57:56 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:56 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:56 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:56 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:56 user nova-compute[72929]:   </devices>
Aug 26 21:57:56 user nova-compute[72929]: </domain>
Aug 26 21:57:56 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-993392427',display_name='tempest-VolumesAdminNegativeTest-server-993392427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-993392427',id=6,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl+Fha5jyKyHHMzP106FLQHrD0ktTRKjpRKvN9MXtqkrzg/dKQqUWTH2zASQV7T0XX0Co/wUktjyuJeFKrrqUsbS3RLFUWefUa6xf4DEfsXuDrZWwkLDTNn4LpDuHzHww==',key_name='tempest-keypair-1029206930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1296783b514e0a93a7d6b8d464335c',ramdisk_id='',reservation_id='r-uvnmumf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1477467048',owner_user_name='tempest-VolumesAdminNegativeTest-1477467048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6509530943dc49dc897e975e0695292f',uuid=90e97032-f5f1-412a-b74a-50528262e6d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converting VIF {"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG os_vif [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6625c989-7f, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6625c989-7f, col_values=(('external_ids', {'iface-id': '6625c989-7fe6-4039-88a7-1d09eb866607', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:68:8b', 'vm-uuid': '90e97032-f5f1-412a-b74a-50528262e6d8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:56 user nova-compute[72929]: INFO os_vif [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f')
Aug 26 21:57:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No VIF found with MAC fa:16:3e:97:68:8b, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updated VIF entry in instance network info cache for port 6625c989-7fe6-4039-88a7-1d09eb866607. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updating instance_info_cache with network_info: [{"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0299e7c1-dcd8-4abd-b939-1c2b846288a7 req-34945f2d-ff45-4151-9fbf-a2ca0ac79853 service nova] Releasing lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6dd981e1-7458-45e5-b5e2-00e0c3c084f7 req-60a3fe68-f0a9-4b17-b903-92e36aaabc62 service nova] Releasing lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquired lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:57:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:58 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updating instance_info_cache with network_info: [{"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Releasing lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Instance network_info: |[{"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Start _get_guest_xml network_info=[{"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:57:38Z,direct_url=<?>,disk_format='qcow2',id=fdb76caf-b4f8-48f8-894b-47c48ce1d283,min_disk=0,min_ram=0,name='',owner='d8fa6d6b86b441a9bd100fcc5dcc1cf0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:57:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': 'fdb76caf-b4f8-48f8-894b-47c48ce1d283'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:57:59 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:59 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:57:38Z,direct_url=<?>,disk_format='qcow2',id=fdb76caf-b4f8-48f8-894b-47c48ce1d283,min_disk=0,min_ram=0,name='',owner='d8fa6d6b86b441a9bd100fcc5dcc1cf0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:57:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1427551150',display_name='tempest-AttachSCSIVolumeTestJSON-server-1427551150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1427551150',id=7,image_ref='fdb76caf-b4f8-48f8-894b-47c48ce1d283',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76fuw1Tv4CpC5Vae2C1A706pk+egpTpfxGHdvQnGFrsSfUvvjwY4W7A1mtznGi3d8bKKET2cpLtWGxAzS18gSq4cM3m2LlSeSx6B1UKq0MP9Xt6UtNzmkwcpoIUy32PQ==',key_name='tempest-keypair-1818727377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0859e779cef94ade81b7cab93675a248',ramdisk_id='',reservation_id='r-mt84eqoj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fdb76caf-b4f8-48f8-894b-47c48ce1d283',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-556521636',owner_user_name='tempest-AttachSCSIVolumeTestJSON-556521636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656e0f45e77346aca4eae789ee358e59',uuid=86b0db90-8909-4572-8d40-888dc5151698,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Converting VIF {"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lazy-loading 'pci_devices' on Instance uuid 86b0db90-8909-4572-8d40-888dc5151698 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:57:59 user nova-compute[72929]:   <uuid>86b0db90-8909-4572-8d40-888dc5151698</uuid>
Aug 26 21:57:59 user nova-compute[72929]:   <name>instance-00000007</name>
Aug 26 21:57:59 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:57:59 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:57:59 user nova-compute[72929]:   <metadata>
Aug 26 21:57:59 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:57:59 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:57:59 user nova-compute[72929]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1427551150</nova:name>
Aug 26 21:57:59 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:57:59</nova:creationTime>
Aug 26 21:57:59 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:57:59 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:57:59 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:57:59 user nova-compute[72929]:       <nova:owner>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:user uuid="656e0f45e77346aca4eae789ee358e59">tempest-AttachSCSIVolumeTestJSON-556521636-project-member</nova:user>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:project uuid="0859e779cef94ade81b7cab93675a248">tempest-AttachSCSIVolumeTestJSON-556521636</nova:project>
Aug 26 21:57:59 user nova-compute[72929]:       </nova:owner>
Aug 26 21:57:59 user nova-compute[72929]:       <nova:root type="image" uuid="fdb76caf-b4f8-48f8-894b-47c48ce1d283"/>
Aug 26 21:57:59 user nova-compute[72929]:       <nova:ports>
Aug 26 21:57:59 user nova-compute[72929]:         <nova:port uuid="da9d466b-10f9-415a-b4d5-85a26b55fd98">
Aug 26 21:57:59 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:57:59 user nova-compute[72929]:         </nova:port>
Aug 26 21:57:59 user nova-compute[72929]:       </nova:ports>
Aug 26 21:57:59 user nova-compute[72929]:     </nova:instance>
Aug 26 21:57:59 user nova-compute[72929]:   </metadata>
Aug 26 21:57:59 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:57:59 user nova-compute[72929]:     <system>
Aug 26 21:57:59 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:57:59 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:57:59 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:57:59 user nova-compute[72929]:       <entry name="serial">86b0db90-8909-4572-8d40-888dc5151698</entry>
Aug 26 21:57:59 user nova-compute[72929]:       <entry name="uuid">86b0db90-8909-4572-8d40-888dc5151698</entry>
Aug 26 21:57:59 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:57:59 user nova-compute[72929]:     </system>
Aug 26 21:57:59 user nova-compute[72929]:   </sysinfo>
Aug 26 21:57:59 user nova-compute[72929]:   <os>
Aug 26 21:57:59 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:57:59 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:57:59 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:57:59 user nova-compute[72929]:   </os>
Aug 26 21:57:59 user nova-compute[72929]:   <features>
Aug 26 21:57:59 user nova-compute[72929]:     <acpi/>
Aug 26 21:57:59 user nova-compute[72929]:     <apic/>
Aug 26 21:57:59 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:57:59 user nova-compute[72929]:   </features>
Aug 26 21:57:59 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:57:59 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:57:59 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:57:59 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:57:59 user nova-compute[72929]:   </clock>
Aug 26 21:57:59 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:57:59 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:57:59 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:57:59 user nova-compute[72929]:   </cpu>
Aug 26 21:57:59 user nova-compute[72929]:   <devices>
Aug 26 21:57:59 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:57:59 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:57:59 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk"/>
Aug 26 21:57:59 user nova-compute[72929]:       <target dev="sda" bus="scsi"/>
Aug 26 21:57:59 user nova-compute[72929]:       <address type="drive" controller="0" unit="0"/>
Aug 26 21:57:59 user nova-compute[72929]:     </disk>
Aug 26 21:57:59 user nova-compute[72929]:     <disk type="file" device="cdrom">
Aug 26 21:57:59 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 21:57:59 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.config"/>
Aug 26 21:57:59 user nova-compute[72929]:       <target dev="sdb" bus="scsi"/>
Aug 26 21:57:59 user nova-compute[72929]:       <address type="drive" controller="0" unit="1"/>
Aug 26 21:57:59 user nova-compute[72929]:     </disk>
Aug 26 21:57:59 user nova-compute[72929]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 26 21:57:59 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:57:59 user nova-compute[72929]:       <mac address="fa:16:3e:0d:9d:ae"/>
Aug 26 21:57:59 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:59 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:57:59 user nova-compute[72929]:       <target dev="tapda9d466b-10"/>
Aug 26 21:57:59 user nova-compute[72929]:     </interface>
Aug 26 21:57:59 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:57:59 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/console.log" append="off"/>
Aug 26 21:57:59 user nova-compute[72929]:     </serial>
Aug 26 21:57:59 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:57:59 user nova-compute[72929]:     <video>
Aug 26 21:57:59 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:57:59 user nova-compute[72929]:     </video>
Aug 26 21:57:59 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:57:59 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:57:59 user nova-compute[72929]:     </rng>
Aug 26 21:57:59 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:57:59 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:57:59 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:57:59 user nova-compute[72929]:     </memballoon>
Aug 26 21:57:59 user nova-compute[72929]:   </devices>
Aug 26 21:57:59 user nova-compute[72929]: </domain>
Aug 26 21:57:59 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1427551150',display_name='tempest-AttachSCSIVolumeTestJSON-server-1427551150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1427551150',id=7,image_ref='fdb76caf-b4f8-48f8-894b-47c48ce1d283',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76fuw1Tv4CpC5Vae2C1A706pk+egpTpfxGHdvQnGFrsSfUvvjwY4W7A1mtznGi3d8bKKET2cpLtWGxAzS18gSq4cM3m2LlSeSx6B1UKq0MP9Xt6UtNzmkwcpoIUy32PQ==',key_name='tempest-keypair-1818727377',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0859e779cef94ade81b7cab93675a248',ramdisk_id='',reservation_id='r-mt84eqoj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fdb76caf-b4f8-48f8-894b-47c48ce1d283',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-556521636',owner_user_name='tempest-AttachSCSIVolumeTestJSON-556521636-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656e0f45e77346aca4eae789ee358e59',uuid=86b0db90-8909-4572-8d40-888dc5151698,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Converting VIF {"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG os_vif [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda9d466b-10, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda9d466b-10, col_values=(('external_ids', {'iface-id': 'da9d466b-10f9-415a-b4d5-85a26b55fd98', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:9d:ae', 'vm-uuid': '86b0db90-8909-4572-8d40-888dc5151698'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:57:59 user nova-compute[72929]: INFO os_vif [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10')
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No BDM found with device name sda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No VIF found with MAC fa:16:3e:0d:9d:ae, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:57:59 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Using config drive
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:57:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:00 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Creating config drive at /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.config
Aug 26 21:58:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx_t9s8v4 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx_t9s8v4" returned: 0 in 0.079s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-358d2194-8d11-4e29-aabb-19cd840b8830 req-bb26da6e-dce9-40d6-84eb-782ab1c34ff6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-358d2194-8d11-4e29-aabb-19cd840b8830 req-bb26da6e-dce9-40d6-84eb-782ab1c34ff6 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-358d2194-8d11-4e29-aabb-19cd840b8830 req-bb26da6e-dce9-40d6-84eb-782ab1c34ff6 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-358d2194-8d11-4e29-aabb-19cd840b8830 req-bb26da6e-dce9-40d6-84eb-782ab1c34ff6 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-358d2194-8d11-4e29-aabb-19cd840b8830 req-bb26da6e-dce9-40d6-84eb-782ab1c34ff6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:00 user nova-compute[72929]: WARNING nova.compute.manager [req-358d2194-8d11-4e29-aabb-19cd840b8830 req-bb26da6e-dce9-40d6-84eb-782ab1c34ff6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state None.
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-9559aa77-0746-403e-8de0-9f692d8564e9 req-0bf1ca67-c416-4596-bdbf-16b62ba42711 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9559aa77-0746-403e-8de0-9f692d8564e9 req-0bf1ca67-c416-4596-bdbf-16b62ba42711 service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9559aa77-0746-403e-8de0-9f692d8564e9 req-0bf1ca67-c416-4596-bdbf-16b62ba42711 service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9559aa77-0746-403e-8de0-9f692d8564e9 req-0bf1ca67-c416-4596-bdbf-16b62ba42711 service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-9559aa77-0746-403e-8de0-9f692d8564e9 req-0bf1ca67-c416-4596-bdbf-16b62ba42711 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:01 user nova-compute[72929]: WARNING nova.compute.manager [req-9559aa77-0746-403e-8de0-9f692d8564e9 req-0bf1ca67-c416-4596-bdbf-16b62ba42711 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state active and task_state None.
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087081.6703537, 90e97032-f5f1-412a-b74a-50528262e6d8 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:01 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] VM Resumed (Lifecycle Event)
Aug 26 21:58:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:58:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Instance spawned successfully.
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:01 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087081.6813407, 90e97032-f5f1-412a-b74a-50528262e6d8 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:01 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] VM Started (Lifecycle Event)
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:02 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:02 user nova-compute[72929]: INFO nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Took 13.57 seconds to spawn the instance on the hypervisor.
Aug 26 21:58:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:58:02 user nova-compute[72929]: INFO nova.compute.claims [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Claim successful on node user
Aug 26 21:58:02 user nova-compute[72929]: INFO nova.compute.manager [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Took 18.96 seconds to build instance.
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d447c71-3ab3-491f-b1a1-ecfab3fbb7f2 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.193s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:02 user nova-compute[72929]: WARNING nova.compute.manager [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state None.
Aug 26 21:58:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] No waiting events found dispatching network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:02 user nova-compute[72929]: WARNING nova.compute.manager [req-59a52b62-59f2-48a8-80f2-be5af1bdd34f req-1d15e2e9-7652-48a3-9f29-96a2ea5bcbd9 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received unexpected event network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 for instance with vm_state active and task_state None.
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-d5e752dc-5cf8-47f0-9fc4-256a707ed648 req-f0556464-7290-47ae-8719-67b63f723c6c service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d5e752dc-5cf8-47f0-9fc4-256a707ed648 req-f0556464-7290-47ae-8719-67b63f723c6c service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d5e752dc-5cf8-47f0-9fc4-256a707ed648 req-f0556464-7290-47ae-8719-67b63f723c6c service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d5e752dc-5cf8-47f0-9fc4-256a707ed648 req-f0556464-7290-47ae-8719-67b63f723c6c service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-d5e752dc-5cf8-47f0-9fc4-256a707ed648 req-f0556464-7290-47ae-8719-67b63f723c6c service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:03 user nova-compute[72929]: WARNING nova.compute.manager [req-d5e752dc-5cf8-47f0-9fc4-256a707ed648 req-f0556464-7290-47ae-8719-67b63f723c6c service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state active and task_state None.
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.490s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:58:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:58:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:58:04 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Creating image(s)
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG nova.policy [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9347c20c29943a0ada7fbf255609767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459f54f128ef4e719c81a1eb92eb817d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.310s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.423s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk 1073741824" returned: 0 in 0.082s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.515s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] No waiting events found dispatching network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:05 user nova-compute[72929]: WARNING nova.compute.manager [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received unexpected event network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 for instance with vm_state active and task_state None.
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] No waiting events found dispatching network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:05 user nova-compute[72929]: WARNING nova.compute.manager [req-0aaf4a44-5218-4684-9f47-dba527cd4167 req-bf81d54f-3a5d-4364-9ad2-08c74cb5f1c7 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received unexpected event network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a for instance with vm_state active and task_state None.
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.307s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Cannot resize image /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Ensure instance console log exists: /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:05 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087085.9858575, 86b0db90-8909-4572-8d40-888dc5151698 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:05 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] VM Resumed (Lifecycle Event)
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:58:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Instance spawned successfully.
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087085.986646, 86b0db90-8909-4572-8d40-888dc5151698 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] VM Started (Lifecycle Event)
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:06 user nova-compute[72929]: INFO nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Took 16.95 seconds to spawn the instance on the hypervisor.
Aug 26 21:58:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:06 user nova-compute[72929]: INFO nova.compute.manager [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Took 21.06 seconds to build instance.
Aug 26 21:58:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1893a4f2-a93e-452a-aa35-b0e6ab4690a6 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.234s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] No waiting events found dispatching network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:07 user nova-compute[72929]: WARNING nova.compute.manager [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received unexpected event network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a for instance with vm_state active and task_state None.
Aug 26 21:58:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:07 user nova-compute[72929]: WARNING nova.compute.manager [req-3d6e6758-d642-4d0b-a2fa-071aa5706796 req-5cbb12aa-592b-4ce1-bc63-eed928cafa5e service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state active and task_state None.
Aug 26 21:58:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:07 user nova-compute[72929]: DEBUG nova.network.neutron [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Successfully created port: 2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f735e0e2-a3fe-4f74-99e9-ddf31a0c4549 req-744d8c67-86f7-415e-88dc-4fdaefc9d238 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f735e0e2-a3fe-4f74-99e9-ddf31a0c4549 req-744d8c67-86f7-415e-88dc-4fdaefc9d238 service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f735e0e2-a3fe-4f74-99e9-ddf31a0c4549 req-744d8c67-86f7-415e-88dc-4fdaefc9d238 service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f735e0e2-a3fe-4f74-99e9-ddf31a0c4549 req-744d8c67-86f7-415e-88dc-4fdaefc9d238 service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f735e0e2-a3fe-4f74-99e9-ddf31a0c4549 req-744d8c67-86f7-415e-88dc-4fdaefc9d238 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:09 user nova-compute[72929]: WARNING nova.compute.manager [req-f735e0e2-a3fe-4f74-99e9-ddf31a0c4549 req-744d8c67-86f7-415e-88dc-4fdaefc9d238 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state active and task_state None.
Aug 26 21:58:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Successfully updated port: 2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquired lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:58:09 user nova-compute[72929]: INFO nova.compute.claims [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Claim successful on node user
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Releasing lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Instance network_info: |[{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Start _get_guest_xml network_info=[{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:58:09 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:09 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:58:09 user nova-compute[72929]: DEBUG nova.objects.instance [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'pci_devices' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:58:10 user nova-compute[72929]:   <uuid>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</uuid>
Aug 26 21:58:10 user nova-compute[72929]:   <name>instance-00000008</name>
Aug 26 21:58:10 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:58:10 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:58:10 user nova-compute[72929]:   <metadata>
Aug 26 21:58:10 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:58:10 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:58:10 user nova-compute[72929]:       <nova:name>tempest-device-tagging-server-1426573410</nova:name>
Aug 26 21:58:10 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:58:09</nova:creationTime>
Aug 26 21:58:10 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:58:10 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:58:10 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:58:10 user nova-compute[72929]:       <nova:owner>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:user uuid="b9347c20c29943a0ada7fbf255609767">tempest-TaggedAttachmentsTest-1623013215-project-member</nova:user>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:project uuid="459f54f128ef4e719c81a1eb92eb817d">tempest-TaggedAttachmentsTest-1623013215</nova:project>
Aug 26 21:58:10 user nova-compute[72929]:       </nova:owner>
Aug 26 21:58:10 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:58:10 user nova-compute[72929]:       <nova:ports>
Aug 26 21:58:10 user nova-compute[72929]:         <nova:port uuid="2079e4a3-b51b-49d9-a227-899cbd486ae5">
Aug 26 21:58:10 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:58:10 user nova-compute[72929]:         </nova:port>
Aug 26 21:58:10 user nova-compute[72929]:       </nova:ports>
Aug 26 21:58:10 user nova-compute[72929]:     </nova:instance>
Aug 26 21:58:10 user nova-compute[72929]:   </metadata>
Aug 26 21:58:10 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:58:10 user nova-compute[72929]:     <system>
Aug 26 21:58:10 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:58:10 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:58:10 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:58:10 user nova-compute[72929]:       <entry name="serial">f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</entry>
Aug 26 21:58:10 user nova-compute[72929]:       <entry name="uuid">f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</entry>
Aug 26 21:58:10 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:58:10 user nova-compute[72929]:     </system>
Aug 26 21:58:10 user nova-compute[72929]:   </sysinfo>
Aug 26 21:58:10 user nova-compute[72929]:   <os>
Aug 26 21:58:10 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:58:10 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:58:10 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:58:10 user nova-compute[72929]:   </os>
Aug 26 21:58:10 user nova-compute[72929]:   <features>
Aug 26 21:58:10 user nova-compute[72929]:     <acpi/>
Aug 26 21:58:10 user nova-compute[72929]:     <apic/>
Aug 26 21:58:10 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:58:10 user nova-compute[72929]:   </features>
Aug 26 21:58:10 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:58:10 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:58:10 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:58:10 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:58:10 user nova-compute[72929]:   </clock>
Aug 26 21:58:10 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:58:10 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:58:10 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:58:10 user nova-compute[72929]:   </cpu>
Aug 26 21:58:10 user nova-compute[72929]:   <devices>
Aug 26 21:58:10 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:58:10 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:58:10 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk"/>
Aug 26 21:58:10 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:58:10 user nova-compute[72929]:     </disk>
Aug 26 21:58:10 user nova-compute[72929]:     <disk type="file" device="cdrom">
Aug 26 21:58:10 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 21:58:10 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.config"/>
Aug 26 21:58:10 user nova-compute[72929]:       <target dev="hda" bus="ide"/>
Aug 26 21:58:10 user nova-compute[72929]:     </disk>
Aug 26 21:58:10 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:58:10 user nova-compute[72929]:       <mac address="fa:16:3e:b6:39:dd"/>
Aug 26 21:58:10 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:58:10 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:58:10 user nova-compute[72929]:       <target dev="tap2079e4a3-b5"/>
Aug 26 21:58:10 user nova-compute[72929]:     </interface>
Aug 26 21:58:10 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:58:10 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/console.log" append="off"/>
Aug 26 21:58:10 user nova-compute[72929]:     </serial>
Aug 26 21:58:10 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:58:10 user nova-compute[72929]:     <video>
Aug 26 21:58:10 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:58:10 user nova-compute[72929]:     </video>
Aug 26 21:58:10 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:58:10 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:58:10 user nova-compute[72929]:     </rng>
Aug 26 21:58:10 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:58:10 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:58:10 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:58:10 user nova-compute[72929]:     </memballoon>
Aug 26 21:58:10 user nova-compute[72929]:   </devices>
Aug 26 21:58:10 user nova-compute[72929]: </domain>
Aug 26 21:58:10 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG os_vif [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2079e4a3-b5, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2079e4a3-b5, col_values=(('external_ids', {'iface-id': '2079e4a3-b51b-49d9-a227-899cbd486ae5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:39:dd', 'vm-uuid': 'f2ae437b-0e1a-4f23-a1a8-56bd3280ed22'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:10 user nova-compute[72929]: INFO os_vif [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5')
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No BDM found with device name hda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No VIF found with MAC fa:16:3e:b6:39:dd, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:58:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Using config drive
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:58:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Creating config drive at /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.config
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptwegk_qe {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmptwegk_qe" returned: 0 in 0.080s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.708s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:58:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.policy [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bd415650cc944de985461a450373f79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a3175ac07ae4981b077b8784d400128', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:58:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Creating image(s)
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "/opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "/opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "/opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.230s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk 1073741824" returned: 0 in 0.064s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-changed-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Refreshing instance network info cache due to event network-changed-2079e4a3-b51b-49d9-a227-899cbd486ae5. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] Acquiring lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] Acquired lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Refreshing network info cache for port 2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.225s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Cannot resize image /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Ensure instance console log exists: /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Successfully created port: abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updated VIF entry in instance network info cache for port 2079e4a3-b51b-49d9-a227-899cbd486ae5. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d22b6043-f470-4740-8f9e-98672d62372a req-f07f283d-0d50-4030-b9a7-5be7b422ec56 service nova] Releasing lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-fb4be65b-e33f-4d44-af46-e55e6868cbe4 req-b08c4460-a7e5-466a-9f48-fad3ee07bf62 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fb4be65b-e33f-4d44-af46-e55e6868cbe4 req-b08c4460-a7e5-466a-9f48-fad3ee07bf62 service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fb4be65b-e33f-4d44-af46-e55e6868cbe4 req-b08c4460-a7e5-466a-9f48-fad3ee07bf62 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fb4be65b-e33f-4d44-af46-e55e6868cbe4 req-b08c4460-a7e5-466a-9f48-fad3ee07bf62 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-fb4be65b-e33f-4d44-af46-e55e6868cbe4 req-b08c4460-a7e5-466a-9f48-fad3ee07bf62 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:12 user nova-compute[72929]: WARNING nova.compute.manager [req-fb4be65b-e33f-4d44-af46-e55e6868cbe4 req-b08c4460-a7e5-466a-9f48-fad3ee07bf62 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 for instance with vm_state building and task_state spawning.
Aug 26 21:58:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Successfully updated port: abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquired lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-changed-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Refreshing instance network info cache due to event network-changed-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] Acquiring lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updating instance_info_cache with network_info: [{"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Releasing lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Instance network_info: |[{"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] Acquired lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Refreshing network info cache for port abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Start _get_guest_xml network_info=[{"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-0821651c-7feb-49c5-beb4-5579aa652588 req-62b1e913-ae09-4be1-b059-2b3277636b5b service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0821651c-7feb-49c5-beb4-5579aa652588 req-62b1e913-ae09-4be1-b059-2b3277636b5b service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0821651c-7feb-49c5-beb4-5579aa652588 req-62b1e913-ae09-4be1-b059-2b3277636b5b service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0821651c-7feb-49c5-beb4-5579aa652588 req-62b1e913-ae09-4be1-b059-2b3277636b5b service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-0821651c-7feb-49c5-beb4-5579aa652588 req-62b1e913-ae09-4be1-b059-2b3277636b5b service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:14 user nova-compute[72929]: WARNING nova.compute.manager [req-0821651c-7feb-49c5-beb4-5579aa652588 req-62b1e913-ae09-4be1-b059-2b3277636b5b service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 for instance with vm_state building and task_state spawning.
Aug 26 21:58:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-330826468',display_name='tempest-VolumesAssistedSnapshotsTest-server-330826468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-330826468',id=9,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0xEDb2N54R4Uuocy5VFEB1kJoGLKLPiZa94rce3jrRqvMXBMKRrjob3+NC46MtjNM/+SBzIf2duTz10PVNlOSwbodNEgwf5hRTRZ6Yhg15OcUVaQBVJ/2ukrvXZ/EUfw==',key_name='tempest-keypair-1953641866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a3175ac07ae4981b077b8784d400128',ramdisk_id='',reservation_id='r-0y9y4hvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1508098153',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1508098153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd415650cc944de985461a450373f79',uuid=67091d20-1923-4efb-92eb-f11df34f85e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Converting VIF {"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.objects.instance [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lazy-loading 'pci_devices' on Instance uuid 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:58:14 user nova-compute[72929]:   <uuid>67091d20-1923-4efb-92eb-f11df34f85e6</uuid>
Aug 26 21:58:14 user nova-compute[72929]:   <name>instance-00000009</name>
Aug 26 21:58:14 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:58:14 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:58:14 user nova-compute[72929]:   <metadata>
Aug 26 21:58:14 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:58:14 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:58:14 user nova-compute[72929]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-330826468</nova:name>
Aug 26 21:58:14 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:58:14</nova:creationTime>
Aug 26 21:58:14 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:58:14 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:58:14 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:58:14 user nova-compute[72929]:       <nova:owner>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:user uuid="2bd415650cc944de985461a450373f79">tempest-VolumesAssistedSnapshotsTest-1508098153-project-member</nova:user>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:project uuid="5a3175ac07ae4981b077b8784d400128">tempest-VolumesAssistedSnapshotsTest-1508098153</nova:project>
Aug 26 21:58:14 user nova-compute[72929]:       </nova:owner>
Aug 26 21:58:14 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:58:14 user nova-compute[72929]:       <nova:ports>
Aug 26 21:58:14 user nova-compute[72929]:         <nova:port uuid="abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab">
Aug 26 21:58:14 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 21:58:14 user nova-compute[72929]:         </nova:port>
Aug 26 21:58:14 user nova-compute[72929]:       </nova:ports>
Aug 26 21:58:14 user nova-compute[72929]:     </nova:instance>
Aug 26 21:58:14 user nova-compute[72929]:   </metadata>
Aug 26 21:58:14 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:58:14 user nova-compute[72929]:     <system>
Aug 26 21:58:14 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:58:14 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:58:14 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:58:14 user nova-compute[72929]:       <entry name="serial">67091d20-1923-4efb-92eb-f11df34f85e6</entry>
Aug 26 21:58:14 user nova-compute[72929]:       <entry name="uuid">67091d20-1923-4efb-92eb-f11df34f85e6</entry>
Aug 26 21:58:14 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:58:14 user nova-compute[72929]:     </system>
Aug 26 21:58:14 user nova-compute[72929]:   </sysinfo>
Aug 26 21:58:14 user nova-compute[72929]:   <os>
Aug 26 21:58:14 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:58:14 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:58:14 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:58:14 user nova-compute[72929]:   </os>
Aug 26 21:58:14 user nova-compute[72929]:   <features>
Aug 26 21:58:14 user nova-compute[72929]:     <acpi/>
Aug 26 21:58:14 user nova-compute[72929]:     <apic/>
Aug 26 21:58:14 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:58:14 user nova-compute[72929]:   </features>
Aug 26 21:58:14 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:58:14 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:58:14 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:58:14 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:58:14 user nova-compute[72929]:   </clock>
Aug 26 21:58:14 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:58:14 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:58:14 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:58:14 user nova-compute[72929]:   </cpu>
Aug 26 21:58:14 user nova-compute[72929]:   <devices>
Aug 26 21:58:14 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:58:14 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:58:14 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk"/>
Aug 26 21:58:14 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:58:14 user nova-compute[72929]:     </disk>
Aug 26 21:58:14 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:58:14 user nova-compute[72929]:       <mac address="fa:16:3e:13:a1:f6"/>
Aug 26 21:58:14 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:58:14 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:58:14 user nova-compute[72929]:       <target dev="tapabd9caaa-30"/>
Aug 26 21:58:14 user nova-compute[72929]:     </interface>
Aug 26 21:58:14 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:58:14 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/console.log" append="off"/>
Aug 26 21:58:14 user nova-compute[72929]:     </serial>
Aug 26 21:58:14 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:58:14 user nova-compute[72929]:     <video>
Aug 26 21:58:14 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:58:14 user nova-compute[72929]:     </video>
Aug 26 21:58:14 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:58:14 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:58:14 user nova-compute[72929]:     </rng>
Aug 26 21:58:14 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:58:14 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:58:14 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:58:14 user nova-compute[72929]:     </memballoon>
Aug 26 21:58:14 user nova-compute[72929]:   </devices>
Aug 26 21:58:14 user nova-compute[72929]: </domain>
Aug 26 21:58:14 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-330826468',display_name='tempest-VolumesAssistedSnapshotsTest-server-330826468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-330826468',id=9,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0xEDb2N54R4Uuocy5VFEB1kJoGLKLPiZa94rce3jrRqvMXBMKRrjob3+NC46MtjNM/+SBzIf2duTz10PVNlOSwbodNEgwf5hRTRZ6Yhg15OcUVaQBVJ/2ukrvXZ/EUfw==',key_name='tempest-keypair-1953641866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a3175ac07ae4981b077b8784d400128',ramdisk_id='',reservation_id='r-0y9y4hvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1508098153',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1508098153-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd415650cc944de985461a450373f79',uuid=67091d20-1923-4efb-92eb-f11df34f85e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Converting VIF {"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG os_vif [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabd9caaa-30, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabd9caaa-30, col_values=(('external_ids', {'iface-id': 'abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:a1:f6', 'vm-uuid': '67091d20-1923-4efb-92eb-f11df34f85e6'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:14 user nova-compute[72929]: INFO os_vif [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30')
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087094.8358781, f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] VM Resumed (Lifecycle Event)
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Instance spawned successfully.
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] No VIF found with MAC fa:16:3e:13:a1:f6, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:58:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:14 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087094.8559616, f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] VM Started (Lifecycle Event)
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:15 user nova-compute[72929]: INFO nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Took 11.08 seconds to spawn the instance on the hypervisor.
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:15 user nova-compute[72929]: INFO nova.compute.manager [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Took 13.42 seconds to build instance.
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.366s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-38fef3e2-a8c1-4422-94ac-ec3c08d6a5d1 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.705s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] No waiting events found dispatching network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:15 user nova-compute[72929]: WARNING nova.compute.manager [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received unexpected event network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 for instance with vm_state active and task_state None.
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] No waiting events found dispatching network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:15 user nova-compute[72929]: WARNING nova.compute.manager [req-d03de747-8c41-45d7-9d00-217bbefcc223 req-c4082a59-3e6b-4f33-bd61-0588667fae35 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received unexpected event network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 for instance with vm_state active and task_state None.
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updated VIF entry in instance network info cache for port abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updating instance_info_cache with network_info: [{"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98d37051-84e8-4429-8350-e06a665d83dc req-1cd0e0c5-b653-4642-b7f6-9737f33bae57 service nova] Releasing lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.398s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-dc8a7e61-cb8e-4a0b-b50a-08227074e497 req-30810d99-1541-43fb-9920-6984dc03ed05 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dc8a7e61-cb8e-4a0b-b50a-08227074e497 req-30810d99-1541-43fb-9920-6984dc03ed05 service nova] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dc8a7e61-cb8e-4a0b-b50a-08227074e497 req-30810d99-1541-43fb-9920-6984dc03ed05 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dc8a7e61-cb8e-4a0b-b50a-08227074e497 req-30810d99-1541-43fb-9920-6984dc03ed05 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-dc8a7e61-cb8e-4a0b-b50a-08227074e497 req-30810d99-1541-43fb-9920-6984dc03ed05 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] No waiting events found dispatching network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:17 user nova-compute[72929]: WARNING nova.compute.manager [req-dc8a7e61-cb8e-4a0b-b50a-08227074e497 req-30810d99-1541-43fb-9920-6984dc03ed05 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received unexpected event network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab for instance with vm_state building and task_state spawning.
Aug 26 21:58:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.404s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] No waiting events found dispatching network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:17 user nova-compute[72929]: WARNING nova.compute.manager [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received unexpected event network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 for instance with vm_state active and task_state None.
Aug 26 21:58:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] No waiting events found dispatching network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:17 user nova-compute[72929]: WARNING nova.compute.manager [req-9a87b6f4-c5d8-4eae-9ddd-9e0d59cae54f req-95d66ef5-020f-4bb5-9f2d-f6743268af72 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received unexpected event network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 for instance with vm_state active and task_state None.
Aug 26 21:58:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087099.94626, 67091d20-1923-4efb-92eb-f11df34f85e6 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] VM Resumed (Lifecycle Event)
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-44d2eb41-763a-48b4-86c7-f4e173b21b6e req-35688c10-3848-468e-a27d-80d976ca9822 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-44d2eb41-763a-48b4-86c7-f4e173b21b6e req-35688c10-3848-468e-a27d-80d976ca9822 service nova] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-44d2eb41-763a-48b4-86c7-f4e173b21b6e req-35688c10-3848-468e-a27d-80d976ca9822 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-44d2eb41-763a-48b4-86c7-f4e173b21b6e req-35688c10-3848-468e-a27d-80d976ca9822 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-44d2eb41-763a-48b4-86c7-f4e173b21b6e req-35688c10-3848-468e-a27d-80d976ca9822 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] No waiting events found dispatching network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:20 user nova-compute[72929]: WARNING nova.compute.manager [req-44d2eb41-763a-48b4-86c7-f4e173b21b6e req-35688c10-3848-468e-a27d-80d976ca9822 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received unexpected event network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab for instance with vm_state building and task_state spawning.
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Instance spawned successfully.
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:58:20 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:20 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7653MB free_disk=24.64044189453125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087099.9535334, 67091d20-1923-4efb-92eb-f11df34f85e6 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] VM Started (Lifecycle Event)
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Took 10.01 seconds to spawn the instance on the hypervisor.
Aug 26 21:58:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:20 user nova-compute[72929]: INFO nova.compute.manager [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Took 11.19 seconds to build instance.
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-065bb866-3b4b-43ea-8d4d-2ef00e23e911 tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.308s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 86b0db90-8909-4572-8d40-888dc5151698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 925086ad-8a40-40e1-a537-a00923a0dd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 67091d20-1923-4efb-92eb-f11df34f85e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 90e97032-f5f1-412a-b74a-50528262e6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 32f5db95-9356-4feb-9dd8-44727cebdde0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.983s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.639s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:21 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:58:21 user nova-compute[72929]: INFO nova.compute.claims [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Claim successful on node user
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:58:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG nova.policy [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c14a8b7c012414ca17ec7ed1630ac02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d7fb7f0afaa4a57a7fb9bd4e4a41f5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:58:22 user nova-compute[72929]: INFO nova.virt.block_device [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Booting with volume f6720532-a4f1-4993-b026-4dac16524e10 at /dev/vda
Aug 26 21:58:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:22 user nova-compute[72929]: DEBUG os_brick.utils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:58:22 user nova-compute[72929]: INFO oslo.privsep.daemon [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmuet4_gv/privsep.sock']
Aug 26 21:58:22 user sudo[84081]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmuet4_gv/privsep.sock
Aug 26 21:58:22 user sudo[84081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 26 21:58:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Skipping network cache update for instance because it is Building. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:58:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Successfully created port: 6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:58:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Successfully updated port: 6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquired lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-changed-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Refreshing instance network info cache due to event network-changed-6d0845c8-db04-4979-8dc2-3e60a8b3536b. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] Acquiring lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:58:25 user sudo[84081]: pam_unix(sudo:session): session closed for user root
Aug 26 21:58:25 user nova-compute[72929]: INFO oslo.privsep.daemon [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Spawned new privsep daemon via rootwrap
Aug 26 21:58:25 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 26 21:58:25 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 26 21:58:25 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 26 21:58:25 user nova-compute[72929]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84150
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cc0506-d490-48e6-a1cd-d1c2ab547f09]: (2,) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updating instance_info_cache with network_info: [{"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Releasing lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance network_info: |[{"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] Acquired lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.network.neutron [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Refreshing network info cache for port 6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f80302-54bd-4c30-b01a-be8005dc90bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:25 user nova-compute[72929]: WARNING os_brick.initiator.connectors.nvmeof [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b37ad19-3d08-496a-9045-091125dcc9ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[411cca6b-de75-46ca-b027-92822c5e88b9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb88d733-fed9-4bb6-a74e-a50c8f605b82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:58:25 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:58:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1ff9a2-01bb-4052-8f45-4e89f9ae7559]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG os_brick.utils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] <== get_connector_properties: return (3179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:58:25 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updating existing volume attachment record: 17a188e8-f859-4055-8d1e-1d1fb569c364 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:58:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updated VIF entry in instance network info cache for port 6d0845c8-db04-4979-8dc2-3e60a8b3536b. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:58:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updating instance_info_cache with network_info: [{"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2aca4d82-1791-485c-aea5-b2d6020c8c6e req-52feab50-1a7f-422e-860e-f65f44258bff service nova] Releasing lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:58:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Creating image(s)
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Ensure instance console log exists: /opt/stack/data/nova/instances/8555f690-3843-4989-8d93-2bf3ce87e8ef/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Start _get_guest_xml network_info=[{"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '17a188e8-f859-4055-8d1e-1d1fb569c364', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWFRKoqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8555f690-3843-4989-8d93-2bf3ce87e8ef', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6720532-a4f1-4993-b026-4dac16524e10', 'serial': 'f6720532-a4f1-4993-b026-4dac16524e10'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:58:38 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:38 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connector [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Factory for ISCSI on None {{(pid=72929) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWFRKoqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:58:38 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:58:38 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:58:38 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b5d01a-bba8-471b-a015-34ff7dd27495]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:58:38 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfc4331-34ed-48f8-9dfe-311b1a4c486c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10] added
Aug 26 21:58:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[73742967-d29f-4768-8405-c75039cd037e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c6a364-ccad-4e97-8082-d45edd4febeb]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWFRKoqw {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWFRKoqw" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd4d8dd-d686-4cca-9ca3-b16e4b455bf2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWFRKoqw'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[01645646-c276-47dd-9e67-38e5c0004e28]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ac55bd-1803-4303-8ba6-45edbdb7dc81]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:58:38 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 21:58:38 user nova-compute[72929]:  {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:58:38 user nova-compute[72929]: WARNING os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 21:58:38 user nova-compute[72929]: 
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2eb250-ff32-4cae-a493-f50742937dc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260]
Aug 26 21:58:38 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260] successful.
Aug 26 21:58:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad429733-f4ee-4883-8e46-7329bae5eb27]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b421ed-dfff-48ac-b3dd-cdf52b814493]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:58:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:58:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75a3c38-1871-4332-aa76-4d703a96b019]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWFRKoqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23838306235396437', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838306235396437', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1555387934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1555387934',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxtD5PEaYK9WFv6hquI4w9DEU2Etd046Y+IFfw3MuWoajH3d8UBwNYEvO/enwLXuvZXfthk8hdZ1Ix0bWudI0PJYcAR0Uw9oRkzFP0iWwLTAgbAwO2VzaGd7ci8aoeU1w==',key_name='tempest-keypair-916840740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d7fb7f0afaa4a57a7fb9bd4e4a41f5e',ramdisk_id='',reservation_id='r-xl9uw4da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-550646581',owner_user_name='tempest-ServerActionsV293TestJSON-550646581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c14a8b7c012414ca17ec7ed1630ac02',uuid=8555f690-3843-4989-8d93-2bf3ce87e8ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converting VIF {"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lazy-loading 'pci_devices' on Instance uuid 8555f690-3843-4989-8d93-2bf3ce87e8ef {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:58:39 user nova-compute[72929]:   <uuid>8555f690-3843-4989-8d93-2bf3ce87e8ef</uuid>
Aug 26 21:58:39 user nova-compute[72929]:   <name>instance-0000000a</name>
Aug 26 21:58:39 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:58:39 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:58:39 user nova-compute[72929]:   <metadata>
Aug 26 21:58:39 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:58:39 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:58:39 user nova-compute[72929]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1555387934</nova:name>
Aug 26 21:58:39 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:58:38</nova:creationTime>
Aug 26 21:58:39 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:58:39 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:58:39 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:58:39 user nova-compute[72929]:       <nova:owner>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:user uuid="8c14a8b7c012414ca17ec7ed1630ac02">tempest-ServerActionsV293TestJSON-550646581-project-member</nova:user>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:project uuid="9d7fb7f0afaa4a57a7fb9bd4e4a41f5e">tempest-ServerActionsV293TestJSON-550646581</nova:project>
Aug 26 21:58:39 user nova-compute[72929]:       </nova:owner>
Aug 26 21:58:39 user nova-compute[72929]:       <nova:ports>
Aug 26 21:58:39 user nova-compute[72929]:         <nova:port uuid="6d0845c8-db04-4979-8dc2-3e60a8b3536b">
Aug 26 21:58:39 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 21:58:39 user nova-compute[72929]:         </nova:port>
Aug 26 21:58:39 user nova-compute[72929]:       </nova:ports>
Aug 26 21:58:39 user nova-compute[72929]:     </nova:instance>
Aug 26 21:58:39 user nova-compute[72929]:   </metadata>
Aug 26 21:58:39 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:58:39 user nova-compute[72929]:     <system>
Aug 26 21:58:39 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:58:39 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:58:39 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:58:39 user nova-compute[72929]:       <entry name="serial">8555f690-3843-4989-8d93-2bf3ce87e8ef</entry>
Aug 26 21:58:39 user nova-compute[72929]:       <entry name="uuid">8555f690-3843-4989-8d93-2bf3ce87e8ef</entry>
Aug 26 21:58:39 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:58:39 user nova-compute[72929]:     </system>
Aug 26 21:58:39 user nova-compute[72929]:   </sysinfo>
Aug 26 21:58:39 user nova-compute[72929]:   <os>
Aug 26 21:58:39 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:58:39 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:58:39 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:58:39 user nova-compute[72929]:   </os>
Aug 26 21:58:39 user nova-compute[72929]:   <features>
Aug 26 21:58:39 user nova-compute[72929]:     <acpi/>
Aug 26 21:58:39 user nova-compute[72929]:     <apic/>
Aug 26 21:58:39 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:58:39 user nova-compute[72929]:   </features>
Aug 26 21:58:39 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:58:39 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:58:39 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:58:39 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:58:39 user nova-compute[72929]:   </clock>
Aug 26 21:58:39 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:58:39 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:58:39 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:58:39 user nova-compute[72929]:   </cpu>
Aug 26 21:58:39 user nova-compute[72929]:   <devices>
Aug 26 21:58:39 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 21:58:39 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:58:39 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 21:58:39 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:58:39 user nova-compute[72929]:       <serial>f6720532-a4f1-4993-b026-4dac16524e10</serial>
Aug 26 21:58:39 user nova-compute[72929]:     </disk>
Aug 26 21:58:39 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:58:39 user nova-compute[72929]:       <mac address="fa:16:3e:ae:a1:4e"/>
Aug 26 21:58:39 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:58:39 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:58:39 user nova-compute[72929]:       <target dev="tap6d0845c8-db"/>
Aug 26 21:58:39 user nova-compute[72929]:     </interface>
Aug 26 21:58:39 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:58:39 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/8555f690-3843-4989-8d93-2bf3ce87e8ef/console.log" append="off"/>
Aug 26 21:58:39 user nova-compute[72929]:     </serial>
Aug 26 21:58:39 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:58:39 user nova-compute[72929]:     <video>
Aug 26 21:58:39 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:58:39 user nova-compute[72929]:     </video>
Aug 26 21:58:39 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:58:39 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:58:39 user nova-compute[72929]:     </rng>
Aug 26 21:58:39 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:58:39 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:58:39 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:58:39 user nova-compute[72929]:     </memballoon>
Aug 26 21:58:39 user nova-compute[72929]:   </devices>
Aug 26 21:58:39 user nova-compute[72929]: </domain>
Aug 26 21:58:39 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1555387934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1555387934',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxtD5PEaYK9WFv6hquI4w9DEU2Etd046Y+IFfw3MuWoajH3d8UBwNYEvO/enwLXuvZXfthk8hdZ1Ix0bWudI0PJYcAR0Uw9oRkzFP0iWwLTAgbAwO2VzaGd7ci8aoeU1w==',key_name='tempest-keypair-916840740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d7fb7f0afaa4a57a7fb9bd4e4a41f5e',ramdisk_id='',reservation_id='r-xl9uw4da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-550646581',owner_user_name='tempest-ServerActionsV293TestJSON-550646581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c14a8b7c012414ca17ec7ed1630ac02',uuid=8555f690-3843-4989-8d93-2bf3ce87e8ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converting VIF {"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG os_vif [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d0845c8-db, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d0845c8-db, col_values=(('external_ids', {'iface-id': '6d0845c8-db04-4979-8dc2-3e60a8b3536b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:a1:4e', 'vm-uuid': '8555f690-3843-4989-8d93-2bf3ce87e8ef'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:39 user nova-compute[72929]: INFO os_vif [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db')
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:58:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] No VIF found with MAC fa:16:3e:ae:a1:4e, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG nova.compute.manager [req-63c6f2dc-c525-435c-99f6-81a653cb5d6d req-472c8f7e-2cd8-4c21-8a36-d3fd156f8f9f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-63c6f2dc-c525-435c-99f6-81a653cb5d6d req-472c8f7e-2cd8-4c21-8a36-d3fd156f8f9f service nova] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-63c6f2dc-c525-435c-99f6-81a653cb5d6d req-472c8f7e-2cd8-4c21-8a36-d3fd156f8f9f service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-63c6f2dc-c525-435c-99f6-81a653cb5d6d req-472c8f7e-2cd8-4c21-8a36-d3fd156f8f9f service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG nova.compute.manager [req-63c6f2dc-c525-435c-99f6-81a653cb5d6d req-472c8f7e-2cd8-4c21-8a36-d3fd156f8f9f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] No waiting events found dispatching network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:41 user nova-compute[72929]: WARNING nova.compute.manager [req-63c6f2dc-c525-435c-99f6-81a653cb5d6d req-472c8f7e-2cd8-4c21-8a36-d3fd156f8f9f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received unexpected event network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b for instance with vm_state building and task_state spawning.
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087123.4573584, 8555f690-3843-4989-8d93-2bf3ce87e8ef => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] VM Resumed (Lifecycle Event)
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance spawned successfully.
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087123.4637275, 8555f690-3843-4989-8d93-2bf3ce87e8ef => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] VM Started (Lifecycle Event)
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-15f4612e-9a7e-4311-8dbe-45cbab86e17e req-fe9a9c32-5374-4259-8e51-076b9d4d777d service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-15f4612e-9a7e-4311-8dbe-45cbab86e17e req-fe9a9c32-5374-4259-8e51-076b9d4d777d service nova] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-15f4612e-9a7e-4311-8dbe-45cbab86e17e req-fe9a9c32-5374-4259-8e51-076b9d4d777d service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-15f4612e-9a7e-4311-8dbe-45cbab86e17e req-fe9a9c32-5374-4259-8e51-076b9d4d777d service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-15f4612e-9a7e-4311-8dbe-45cbab86e17e req-fe9a9c32-5374-4259-8e51-076b9d4d777d service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] No waiting events found dispatching network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:58:43 user nova-compute[72929]: WARNING nova.compute.manager [req-15f4612e-9a7e-4311-8dbe-45cbab86e17e req-fe9a9c32-5374-4259-8e51-076b9d4d777d service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received unexpected event network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b for instance with vm_state building and task_state spawning.
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 26 21:58:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:58:43 user nova-compute[72929]: INFO nova.compute.manager [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Took 22.94 seconds to build instance.
Aug 26 21:58:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e763faad-1127-4b22-aa4a-839937eb0ca6 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.093s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:58:53 user nova-compute[72929]: INFO nova.compute.claims [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Claim successful on node user
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:58:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:58:54 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:58:54 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:58:54 user nova-compute[72929]: INFO nova.virt.block_device [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Booting with volume 136d902b-c078-43d7-9b3f-80b38442bec1 at /dev/vda
Aug 26 21:58:54 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e23269-77da-4c49-a76b-938f11217c84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab14dcde-c7e7-46e9-b303-4d0efc93a245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[535f0fa0-5f42-4e6e-91f0-52e61653a8cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18fe077-0962-4c6a-ba06-99cf5b9de94d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG nova.policy [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cafed116bbc9411dbff17af1b2b34792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457688283de340618fb3506750a7c737', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:58:54 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:58:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edd2bf9-384d-492e-a28a-ea1bf787c358]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating existing volume attachment record: dabf29a5-e923-4329-b29a-e349413baaa4 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:58:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully created port: d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully created port: 0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully created port: 2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully created port: 71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:57 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully created port: d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG nova.compute.manager [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG nova.compute.manager [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-d359e5a7-2499-40d3-9b7c-e269a2120ade. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG nova.network.neutron [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:58:58 user nova-compute[72929]: DEBUG nova.network.neutron [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG nova.network.neutron [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-898e4769-b44f-4d92-b6b0-f32967dbd877 req-fc008799-499a-4031-aaca-57b178d84419 service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:58:59 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: 171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-171a196d-bcf5-4522-a18a-e5b7267a67f2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port 171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-e61229de-f1d1-4f96-8f3c-e4cae5e871b0. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c71a167-c152-48c4-99f5-cf16abe9c390 req-45b6814e-08e6-4018-b213-4b77a2209578 service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:01 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: 0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: 2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-0d9eb10a-c2b8-438e-9e48-c58fb2e72098. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG nova.network.neutron [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port 0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:02 user nova-compute[72929]: DEBUG nova.network.neutron [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: 71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-2b7e5c06-a545-4009-a95f-dae7ecee44f6. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port 2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a684c04b-bbe2-495f-a451-5d3b69449f79 req-50cc2700-ab9e-467b-bdc6-c54feb87e7f6 service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Successfully updated port: d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:59:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:59:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-71b71ee5-cff0-495d-a247-75f7252edba0. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance network_info: |[{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port 71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updated VIF entry in instance network info cache for port 71b71ee5-cff0-495d-a247-75f7252edba0. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-d2a82b2b-f386-45ff-9108-ee0597716cb1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updated VIF entry in instance network info cache for port d2a82b2b-f386-45ff-9108-ee0597716cb1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa06b01f-875a-4d24-8449-ad5752950247 req-607ba7b6-0726-49d1-987c-7b4cd504d4da service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updating instance_info_cache with network_info: [{"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-32f5db95-9356-4feb-9dd8-44727cebdde0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:12 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:16 user nova-compute[72929]: INFO nova.compute.manager [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Rescuing
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updating instance_info_cache with network_info: [{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 21:59:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-102fbd0e-9d48-4d76-8343-45f39456eb19 req-8a04ea6f-b506-49d0-b0c1-23e58888389c service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-unplugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-102fbd0e-9d48-4d76-8343-45f39456eb19 req-8a04ea6f-b506-49d0-b0c1-23e58888389c service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-102fbd0e-9d48-4d76-8343-45f39456eb19 req-8a04ea6f-b506-49d0-b0c1-23e58888389c service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-102fbd0e-9d48-4d76-8343-45f39456eb19 req-8a04ea6f-b506-49d0-b0c1-23e58888389c service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-102fbd0e-9d48-4d76-8343-45f39456eb19 req-8a04ea6f-b506-49d0-b0c1-23e58888389c service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-unplugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:17 user nova-compute[72929]: WARNING nova.compute.manager [req-102fbd0e-9d48-4d76-8343-45f39456eb19 req-8a04ea6f-b506-49d0-b0c1-23e58888389c service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-unplugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state active and task_state rescuing.
Aug 26 21:59:17 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:59:17 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:59:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=6901MB free_disk=24.505218505859375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:17 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance destroyed successfully.
Aug 26 21:59:18 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Attempting rescue
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72929) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 21:59:18 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Creating image(s)
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lazy-loading 'flavor' on Instance uuid 32f5db95-9356-4feb-9dd8-44727cebdde0 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 32f5db95-9356-4feb-9dd8-44727cebdde0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 925086ad-8a40-40e1-a537-a00923a0dd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 90e97032-f5f1-412a-b74a-50528262e6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 86b0db90-8909-4572-8d40-888dc5151698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 67091d20-1923-4efb-92eb-f11df34f85e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.174s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.236s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue" returned: 0 in 0.051s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'migration_context' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.base [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<2f582511-ae2c-47e3-aa26-86e173891e56> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Start _get_guest_xml network_info=[{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:38:70:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'resources' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.base [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<2f582511-ae2c-47e3-aa26-86e173891e56> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:18 user nova-compute[72929]: INFO nova.compute.manager [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Attaching volume 5a876208-1078-4345-bb1a-39a5e6ac4599 to /dev/vdb
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.base [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<2f582511-ae2c-47e3-aa26-86e173891e56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:59:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.base [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<2f582511-ae2c-47e3-aa26-86e173891e56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-284762778',display_name='tempest-ServerRescueNegativeTestJSON-server-284762778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-284762778',id=3,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-ncm66cmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:47Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=2f582511-ae2c-47e3-aa26-86e173891e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:38:70:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:38:70:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG os_brick.utils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.objects.base [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<2f582511-ae2c-47e3-aa26-86e173891e56> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:59:18 user nova-compute[72929]:   <uuid>2f582511-ae2c-47e3-aa26-86e173891e56</uuid>
Aug 26 21:59:18 user nova-compute[72929]:   <name>instance-00000003</name>
Aug 26 21:59:18 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:59:18 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:59:18 user nova-compute[72929]:   <metadata>
Aug 26 21:59:18 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:59:18 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:59:18 user nova-compute[72929]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-284762778</nova:name>
Aug 26 21:59:18 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:59:18</nova:creationTime>
Aug 26 21:59:18 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:59:18 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:59:18 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:59:18 user nova-compute[72929]:       <nova:owner>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:user uuid="6c2dac68027a44a09a4deadab28f2981">tempest-ServerRescueNegativeTestJSON-26026282-project-member</nova:user>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:project uuid="4e6d14fc09c246779e46e7c816370a1c">tempest-ServerRescueNegativeTestJSON-26026282</nova:project>
Aug 26 21:59:18 user nova-compute[72929]:       </nova:owner>
Aug 26 21:59:18 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:59:18 user nova-compute[72929]:       <nova:ports>
Aug 26 21:59:18 user nova-compute[72929]:         <nova:port uuid="6445469e-029a-41c3-8079-da27e416b226">
Aug 26 21:59:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 21:59:18 user nova-compute[72929]:         </nova:port>
Aug 26 21:59:18 user nova-compute[72929]:       </nova:ports>
Aug 26 21:59:18 user nova-compute[72929]:     </nova:instance>
Aug 26 21:59:18 user nova-compute[72929]:   </metadata>
Aug 26 21:59:18 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:59:18 user nova-compute[72929]:     <system>
Aug 26 21:59:18 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:59:18 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:59:18 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:59:18 user nova-compute[72929]:       <entry name="serial">2f582511-ae2c-47e3-aa26-86e173891e56</entry>
Aug 26 21:59:18 user nova-compute[72929]:       <entry name="uuid">2f582511-ae2c-47e3-aa26-86e173891e56</entry>
Aug 26 21:59:18 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:59:18 user nova-compute[72929]:     </system>
Aug 26 21:59:18 user nova-compute[72929]:   </sysinfo>
Aug 26 21:59:18 user nova-compute[72929]:   <os>
Aug 26 21:59:18 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:59:18 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:59:18 user nova-compute[72929]:   </os>
Aug 26 21:59:18 user nova-compute[72929]:   <features>
Aug 26 21:59:18 user nova-compute[72929]:     <acpi/>
Aug 26 21:59:18 user nova-compute[72929]:     <apic/>
Aug 26 21:59:18 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:59:18 user nova-compute[72929]:   </features>
Aug 26 21:59:18 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:59:18 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:59:18 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:59:18 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:59:18 user nova-compute[72929]:   </clock>
Aug 26 21:59:18 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:59:18 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:59:18 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:59:18 user nova-compute[72929]:   </cpu>
Aug 26 21:59:18 user nova-compute[72929]:   <devices>
Aug 26 21:59:18 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:59:18 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:59:18 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue"/>
Aug 26 21:59:18 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:59:18 user nova-compute[72929]:     </disk>
Aug 26 21:59:18 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:59:18 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:59:18 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk"/>
Aug 26 21:59:18 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 21:59:18 user nova-compute[72929]:     </disk>
Aug 26 21:59:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:59:18 user nova-compute[72929]:       <mac address="fa:16:3e:38:70:ac"/>
Aug 26 21:59:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:59:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:59:18 user nova-compute[72929]:       <target dev="tap6445469e-02"/>
Aug 26 21:59:18 user nova-compute[72929]:     </interface>
Aug 26 21:59:18 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:59:18 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/console.log" append="off"/>
Aug 26 21:59:18 user nova-compute[72929]:     </serial>
Aug 26 21:59:18 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:59:18 user nova-compute[72929]:     <video>
Aug 26 21:59:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:59:18 user nova-compute[72929]:     </video>
Aug 26 21:59:18 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:59:18 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:59:18 user nova-compute[72929]:     </rng>
Aug 26 21:59:18 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:59:18 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:59:18 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:59:18 user nova-compute[72929]:     </memballoon>
Aug 26 21:59:18 user nova-compute[72929]:   </devices>
Aug 26 21:59:18 user nova-compute[72929]: </domain>
Aug 26 21:59:18 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b9c2c2-9339-4202-abcb-6afdf2ce7fb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance destroyed successfully.
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62b0ca8-9207-4132-98ed-9a1ad93d829c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[880b4a71-15e3-448c-a65d-297013df6327]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b2ebbf-1a78-4004-b780-c733791dfd01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:18 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa41a2ca-9995-4070-9fb1-df8d0bd485ad]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG os_brick.utils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updating existing volume attachment record: 5db63f63-43c4-49f7-bc51-35dcbff820a6 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-changed-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Refreshing instance network info cache due to event network-changed-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] Acquiring lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] Acquired lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.network.neutron [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Refreshing network info cache for port 73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:38:70:ac, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 21:59:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.873s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 21:59:19 user nova-compute[72929]: INFO nova.virt.block_device [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Booting with volume e7046cf6-d3ae-4109-bfce-b6278ac12340 at /dev/vdb
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updated VIF entry in instance network info cache for port 73b207d0-01f3-48c1-b5b1-2e5cd6bc569a. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updating instance_info_cache with network_info: [{"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9d8b5e-f0c1-4701-afb8-666f98ce73b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-026edc2a-94a1-44bd-9858-db6f2b9aca48 req-e4791e0d-417f-4179-99b5-3b6937c4909c service nova] Releasing lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00a72d-6848-4b69-bc06-849c59c75c9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2629ab-35c1-465d-83bc-737d8e98086e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f60f92-3072-450e-98bd-6d3c69dd6d39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:19 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbafa9f-eefe-45b4-804a-d8a6a23b8358]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating existing volume attachment record: 47ef67cc-5792-48cb-a289-ddbc64624728 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-47bbd905-b5d0-40cf-a68c-be4ebadee45e req-fa167ed0-4b22-4204-819e-595be4cdd85a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47bbd905-b5d0-40cf-a68c-be4ebadee45e req-fa167ed0-4b22-4204-819e-595be4cdd85a service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47bbd905-b5d0-40cf-a68c-be4ebadee45e req-fa167ed0-4b22-4204-819e-595be4cdd85a service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47bbd905-b5d0-40cf-a68c-be4ebadee45e req-fa167ed0-4b22-4204-819e-595be4cdd85a service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-47bbd905-b5d0-40cf-a68c-be4ebadee45e req-fa167ed0-4b22-4204-819e-595be4cdd85a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:19 user nova-compute[72929]: WARNING nova.compute.manager [req-47bbd905-b5d0-40cf-a68c-be4ebadee45e req-fa167ed0-4b22-4204-819e-595be4cdd85a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state active and task_state rescuing.
Aug 26 21:59:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing instance network info cache due to event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updated VIF entry in instance network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a89de171-4f18-4709-965d-25787cdc2d1f req-54255dfc-9e25-4b3a-abe3-b68ba5ced72a service nova] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:21 user nova-compute[72929]: WARNING nova.compute.manager [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state active and task_state rescuing.
Aug 26 21:59:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:21 user nova-compute[72929]: WARNING nova.compute.manager [req-00ee0d63-9380-4505-8055-e6bca7d3763d req-193d1dbe-f482-4abd-ab5c-31dad2078e7a service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state active and task_state rescuing.
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 2f582511-ae2c-47e3-aa26-86e173891e56 due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087162.4840522, 2f582511-ae2c-47e3-aa26-86e173891e56 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:59:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] VM Resumed (Lifecycle Event)
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-45ec45e5-bff5-480a-819a-b18a52a63a85 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:59:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087162.4888606, 2f582511-ae2c-47e3-aa26-86e173891e56 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:59:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] VM Started (Lifecycle Event)
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:59:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 21:59:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:24 user nova-compute[72929]: INFO nova.compute.manager [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Attaching volume 6de22c4b-9c35-493c-821c-c43c04174ece to /dev/vdb
Aug 26 21:59:24 user nova-compute[72929]: DEBUG os_brick.utils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[65215d99-495b-40b8-80ab-d070db7ef8d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7d8f51-0e88-4913-8371-f01c1c9cd1d6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[809769be-0ff0-4d18-8233-04c791fad33c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f387b802-20b4-4f6c-bc0f-252000b29529]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:24 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:24 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec736b6-8a13-4b47-b54c-1ef486fb0954]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG os_brick.utils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updating existing volume attachment record: cce79fc5-c36b-4426-a7a6-0b9a2c188040 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUDnyxqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:34 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:34 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:34 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-changed-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Refreshing instance network info cache due to event network-changed-6625c989-7fe6-4039-88a7-1d09eb866607. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] Acquiring lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] Acquired lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Refreshing network info cache for port 6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2678fe33-7430-46a4-9752-fc07ad025dbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:59:34 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff3836-4937-4872-91c8-fe71370e86bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599] added
Aug 26 21:59:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d5210-ba81-46d4-919a-c5b1bcd1625a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[65868099-e4ca-4c44-ba55-9f1248880a88]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUDnyxqc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PUDnyxqc" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9817c1-bb58-465a-a4a1-3ea9edfdea10]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PUDnyxqc'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[338aeb4b-2d5a-4976-860a-0828ae9ebe8c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[040adc55-51e5-4088-bea3-2e2036583358]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[549d7fcf-6965-4368-b89d-96abb8bfadc8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260]
Aug 26 21:59:34 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260] successful.
Aug 26 21:59:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[209009e9-5982-4292-b59a-a71d99f353fb]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8106cc56-b53d-4684-b64b-72a6f6f6dedd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:34 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:34 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b5e5cc-15e3-4a7a-9957-c84b8c7f56bd]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUDnyxqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updated VIF entry in instance network info cache for port 6625c989-7fe6-4039-88a7-1d09eb866607. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updating instance_info_cache with network_info: [{"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0f26bdf-7a4b-47bd-a963-8c7d71a569f5 req-5bddde77-23bd-4c36-a82d-acb8b7deebe7 service nova] Releasing lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:35 user nova-compute[72929]: INFO nova.virt.block_device [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Booting with volume 5f7f1008-22bb-4a2c-bfdd-f066cd82c35a at /dev/vdc
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db22736-1cd0-4832-8774-1c3ef244c42c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64c2276-ed88-4b66-90ca-ebb5a50504c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a38102f-5705-4d82-9464-cf88ef07122a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[08295a4e-7736-4aec-943e-6a522c8ded6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:35 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5b4147-7cd9-46a5-a720-9c00d2572d8f]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating existing volume attachment record: b0b60377-8147-4bee-8529-186311cdb29e {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23365323166636235', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365323166636235', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lazy-loading 'flavor' on Instance uuid 32f5db95-9356-4feb-9dd8-44727cebdde0 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:59:35 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:59:35 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 21:59:35 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:59:35 user nova-compute[72929]:   <serial>5a876208-1078-4345-bb1a-39a5e6ac4599</serial>
Aug 26 21:59:35 user nova-compute[72929]: </disk>
Aug 26 21:59:35 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Shelving
Aug 26 21:59:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-697a6411-02eb-4781-b0d3-dc951a0e6c3d req-27340096-49d6-45fc-880f-e07ca50ae66c service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-697a6411-02eb-4781-b0d3-dc951a0e6c3d req-27340096-49d6-45fc-880f-e07ca50ae66c service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-697a6411-02eb-4781-b0d3-dc951a0e6c3d req-27340096-49d6-45fc-880f-e07ca50ae66c service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-697a6411-02eb-4781-b0d3-dc951a0e6c3d req-27340096-49d6-45fc-880f-e07ca50ae66c service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-697a6411-02eb-4781-b0d3-dc951a0e6c3d req-27340096-49d6-45fc-880f-e07ca50ae66c service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:36 user nova-compute[72929]: WARNING nova.compute.manager [req-697a6411-02eb-4781-b0d3-dc951a0e6c3d req-27340096-49d6-45fc-880f-e07ca50ae66c service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state active and task_state shelving.
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] No VIF found with MAC fa:16:3e:9f:97:5d, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-changed-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Refreshing instance network info cache due to event network-changed-da9d466b-10f9-415a-b4d5-85a26b55fd98. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] Acquiring lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] Acquired lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Refreshing network info cache for port da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUHQPVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:36 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:36 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:36 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f290b49-31c4-4f59-862e-7862e4136862]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:59:36 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f18d2ad-3c16-4bc6-8683-2750d3bebf3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece] added
Aug 26 21:59:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance destroyed successfully.
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da5f558-ba46-4bfb-86bb-05a607ea8fb5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a08089-af3c-409d-b45a-729d63461b41]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUHQPVje {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5197ad6a-0f72-4638-84ce-ea0d2c67cd48 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.230s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KUHQPVje" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af5af5f-78de-46d0-b8ad-0a00af78123c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KUHQPVje'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3232616e-f021-452d-8a92-846dcf56fc23]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Beginning cold snapshot process
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1283bd9-001c-466a-825a-675d43055cc0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:36 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:36 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:36 user nova-compute[72929]: INFO nova.compute.manager [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Terminating instance
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 21:59:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk /opt/stack/data/nova/instances/snapshots/tmpyilt_j83/6bd77ae233864d7c85c8cb5ba16f6501 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updated VIF entry in instance network info cache for port da9d466b-10f9-415a-b4d5-85a26b55fd98. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updating instance_info_cache with network_info: [{"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6b0ee06c-e88f-4357-8347-192115ddc4c6 req-85f10977-5e6b-447d-bd67-d4248c4094f0 service nova] Releasing lock "refresh_cache-86b0db90-8909-4572-8d40-888dc5151698" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --login" returned: 0 in 1.079s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe7037d-373a-4faf-8123-f8751d342d37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260]
Aug 26 21:59:37 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260] successful.
Aug 26 21:59:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Instance destroyed successfully.
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lazy-loading 'resources' on Instance uuid 32f5db95-9356-4feb-9dd8-44727cebdde0 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b30626e-6840-4f8e-b0d9-df30496b2278]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-845530859',display_name='tempest-DeleteServersTestJSON-server-845530859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-845530859',id=2,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d082ef6806524abc8e771889da65faf7',ramdisk_id='',reservation_id='r-uiy3zyaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-963247611',owner_user_name='tempest-DeleteServersTestJSON-963247611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:57:47Z,user_data=None,user_id='e1f096d5ce9547a09fdb841fc10e89f1',uuid=32f5db95-9356-4feb-9dd8-44727cebdde0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Converting VIF {"id": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "address": "fa:16:3e:9f:97:5d", "network": {"id": "7b6cccca-2c9b-45e7-98eb-a0632c533fa1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-610561656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d082ef6806524abc8e771889da65faf7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27f412b2-a4", "ovs_interfaceid": "27f412b2-a4dd-4619-987f-f03a90ded0b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_vif [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27f412b2-a4, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b898b-dcf5-4d43-be4c-bf34828de8c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:37 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:37 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:37 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:37 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.360s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk /opt/stack/data/nova/instances/snapshots/tmpyilt_j83/6bd77ae233864d7c85c8cb5ba16f6501" returned: 0 in 0.875s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Snapshot extracted, beginning image upload
Aug 26 21:59:37 user nova-compute[72929]: INFO os_vif [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:97:5d,bridge_name='br-int',has_traffic_filtering=True,id=27f412b2-a4dd-4619-987f-f03a90ded0b1,network=Network(7b6cccca-2c9b-45e7-98eb-a0632c533fa1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27f412b2-a4')
Aug 26 21:59:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PUDnyxqc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:37 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a214e4f5-453b-4861-8284-bb7d35072b2d]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:59:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUHQPVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:38 user nova-compute[72929]: WARNING nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-vif-unplugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] No waiting events found dispatching network-vif-unplugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-vif-unplugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Acquiring lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] No waiting events found dispatching network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:38 user nova-compute[72929]: WARNING nova.compute.manager [req-91c881a5-a11f-4aec-be66-34616bf0cfe3 req-081dee13-2868-4d4a-8c70-478688c12ce0 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received unexpected event network-vif-plugged-27f412b2-a4dd-4619-987f-f03a90ded0b1 for instance with vm_state active and task_state deleting.
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.404s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== connect_volume: return (2407ms) {'type': 'block', 'scsi_wwn': '26534623361333362', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534623361333362', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.020s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc5c7b-f890-4753-bff8-806338626dd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:59:38 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:59:38 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 21:59:38 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:59:38 user nova-compute[72929]:   <serial>6de22c4b-9c35-493c-821c-c43c04174ece</serial>
Aug 26 21:59:38 user nova-compute[72929]: </disk>
Aug 26 21:59:38 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cedc03-fed7-4d2c-8784-ec75dacf88f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:38 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:38 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:38 user nova-compute[72929]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 (non-flash)
Aug 26 21:59:38 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b981bf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[65854037-e997-4443-b536-55610e93f3ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63176c8-2ab6-41ed-adf3-38b47907ed8e]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[41435ad8-e504-4dc0-afaa-7cba2e38e549]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6a326f-839e-430b-b661-fcf320108406]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[839b9a4b-b74e-445a-a12a-78cc4cc638ca]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef681000-7207-477a-ac5d-46298deb6b96]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260]
Aug 26 21:59:39 user nova-compute[72929]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599, portal: 172.16.0.220,3260] successful.
Aug 26 21:59:39 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a876208-1078-4345-bb1a-39a5e6ac4599 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b03da6-bac5-4f05-bfc4-ddb27145a710]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] <== disconnect_volume: return (1298ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:59:39 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Deleting instance files /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0_del
Aug 26 21:59:39 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Deletion of /opt/stack/data/nova/instances/32f5db95-9356-4feb-9dd8-44727cebdde0_del complete
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72929) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 26 21:59:39 user nova-compute[72929]: INFO nova.virt.libvirt.host [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] UEFI support detected
Aug 26 21:59:39 user nova-compute[72929]: INFO nova.compute.manager [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Took 2.31 seconds to destroy the instance on the hypervisor.
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:6c:41:e5, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.objects.instance [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'flavor' on Instance uuid 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8997e418-cc66-467c-bcf2-ba5a87de3684 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.392s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:39 user nova-compute[72929]: INFO nova.compute.manager [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Attaching volume 17f49c79-3ca6-460a-87fe-da50ce8d05dd to /dev/vdb
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.utils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea0d6b3-72f8-4b9f-81ed-f3690de26015]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c943ca-e3f0-4967-b2b3-ddd12c5015a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ba803-a3d8-4628-8686-789b217c41c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c9211d-9f54-4836-9dff-f54b5f8715fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:39 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f0acf-c637-4f0b-be4b-389ee01be37a]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG os_brick.utils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:39 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updating existing volume attachment record: f6557597-b640-4cbf-8ca7-e637acd7361a {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:40 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Snapshot image upload complete
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-be795224-d57d-4e98-9fa1-34b77256b550 req-bbc8ca7a-adf5-49e5-bcac-5a24edeffee4 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Received event network-vif-deleted-27f412b2-a4dd-4619-987f-f03a90ded0b1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:40 user nova-compute[72929]: INFO nova.compute.manager [req-be795224-d57d-4e98-9fa1-34b77256b550 req-bbc8ca7a-adf5-49e5-bcac-5a24edeffee4 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Neutron deleted interface 27f412b2-a4dd-4619-987f-f03a90ded0b1; detaching it from the instance and deleting it from the info cache
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.network.neutron [req-be795224-d57d-4e98-9fa1-34b77256b550 req-bbc8ca7a-adf5-49e5-bcac-5a24edeffee4 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:40 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Took 1.40 seconds to deallocate network for instance.
Aug 26 21:59:40 user nova-compute[72929]: INFO nova.compute.manager [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Shelve offloading
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-be795224-d57d-4e98-9fa1-34b77256b550 req-bbc8ca7a-adf5-49e5-bcac-5a24edeffee4 service nova] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Detach interface failed, port_id=27f412b2-a4dd-4619-987f-f03a90ded0b1, reason: Instance 32f5db95-9356-4feb-9dd8-44727cebdde0 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 21:59:40 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance destroyed successfully.
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:40 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:41 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance destroyed successfully.
Aug 26 21:59:41 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'resources' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584320566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584320566',id=5,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFaPTVM4OFRu1DthBEJTVU2EIFqlrkWnEW06IquF3BgEMnN3jf16w1C+hlgxb4vW3PW0MZWYJRsFdtZHXX3UIpkEai0Zlf+C0WaylyFHaJFyimjpZ4ei+spTEGUz+6FQ==',key_name='tempest-keypair-144813694',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-6z0hzvy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member',shelved_at='2023-08-26T21:59:40.548343',shelved_host='user',shelved_image_id='7e4e83f6-2924-47e1-8941-c82579c55681'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=925086ad-8a40-40e1-a537-a00923a0dd3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG os_vif [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb33f29b7-cf, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:41 user nova-compute[72929]: INFO nova.compute.manager [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Took 1.30 seconds to detach 1 volumes for instance.
Aug 26 21:59:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:59:41 user nova-compute[72929]: INFO os_vif [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf')
Aug 26 21:59:41 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Deleting instance files /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f_del
Aug 26 21:59:41 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Deletion of /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f_del complete
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:42 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Deleted allocations for instance 925086ad-8a40-40e1-a537-a00923a0dd3f
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lazy-loading 'flavor' on Instance uuid 86b0db90-8909-4572-8d40-888dc5151698 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.151s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.256s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'numa_topology' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.objects.base [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<925086ad-8a40-40e1-a537-a00923a0dd3f> lazy-loaded attributes: resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:42 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Deleted allocations for instance 32f5db95-9356-4feb-9dd8-44727cebdde0
Aug 26 21:59:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3b33a734-25c9-41f8-a065-a627f99c7440 tempest-DeleteServersTestJSON-963247611 tempest-DeleteServersTestJSON-963247611-project-member] Lock "32f5db95-9356-4feb-9dd8-44727cebdde0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.736s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:42 user nova-compute[72929]: INFO nova.compute.manager [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Attaching volume 64fe871f-c73d-45a2-a618-2f6ba1dd27c9 to /dev/sdc
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing instance network info cache due to event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG os_brick.utils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fc9096-9883-4307-b27e-f4a67916f354]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b6330f-ec2e-4558-93ba-252c73c88527]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[38be836b-f041-4dac-a7ff-cb9f69ac99cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[007bd23d-3210-43c9-a780-215920aa09bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:42 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[813730ca-b220-497b-910d-72143f113d9b]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG os_brick.utils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updating existing volume attachment record: 14df5b6e-10fb-441a-babc-61f53c856aae {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.471s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5e4fa91b-a909-4103-8fd9-1e7aac90ac8b tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.408s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "5333d644-7490-4e03-ba39-63168ffd4d12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG nova.network.neutron [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updated VIF entry in instance network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG nova.network.neutron [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dd05153b-e6b8-4349-8f9f-406a45c3cb7c req-e61c464f-d32e-4ffc-9000-0d43b14ce5f6 service nova] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 21:59:43 user nova-compute[72929]: INFO nova.compute.claims [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Claim successful on node user
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.844s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:59:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.policy [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ef1bea627245e29428b442787db7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a593fe9fb7a442f08880ecd2fab42df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 21:59:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Creating image(s)
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "/opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk 1073741824" returned: 0 in 0.131s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Successfully created port: e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Cannot resize image /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Ensure instance console log exists: /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Successfully updated port: e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquired lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-changed-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Refreshing instance network info cache due to event network-changed-e55d4fb5-4832-428f-9379-faa4e3ffb801. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] Acquiring lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Updating instance_info_cache with network_info: [{"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Releasing lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Instance network_info: |[{"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] Acquired lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Refreshing network info cache for port e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Start _get_guest_xml network_info=[{"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 21:59:46 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:59:46 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-511598667',display_name='tempest-AttachVolumeNegativeTest-server-511598667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-511598667',id=12,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdsrCwmFngvQvYs2C/I+pyb5aQk0B1FLWBICiW3FCiW5N/0KTaFkIIpRK5Csx9EqXYzrR5zmuQG/a5/QzA5GfqZBOzKEd77xxE1gEvGoreWM1nAeBhlv7adDz2krVDkDA==',key_name='tempest-keypair-147163806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-7rgrtbdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=5333d644-7490-4e03-ba39-63168ffd4d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'pci_devices' on Instance uuid 5333d644-7490-4e03-ba39-63168ffd4d12 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] End _get_guest_xml xml=<domain type="kvm">
Aug 26 21:59:46 user nova-compute[72929]:   <uuid>5333d644-7490-4e03-ba39-63168ffd4d12</uuid>
Aug 26 21:59:46 user nova-compute[72929]:   <name>instance-0000000c</name>
Aug 26 21:59:46 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 21:59:46 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 21:59:46 user nova-compute[72929]:   <metadata>
Aug 26 21:59:46 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:59:46 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 21:59:46 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeNegativeTest-server-511598667</nova:name>
Aug 26 21:59:46 user nova-compute[72929]:       <nova:creationTime>2023-08-26 21:59:46</nova:creationTime>
Aug 26 21:59:46 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 21:59:46 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 21:59:46 user nova-compute[72929]:       </nova:flavor>
Aug 26 21:59:46 user nova-compute[72929]:       <nova:owner>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:user uuid="64ef1bea627245e29428b442787db7b7">tempest-AttachVolumeNegativeTest-600362177-project-member</nova:user>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:project uuid="a593fe9fb7a442f08880ecd2fab42df6">tempest-AttachVolumeNegativeTest-600362177</nova:project>
Aug 26 21:59:46 user nova-compute[72929]:       </nova:owner>
Aug 26 21:59:46 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:59:46 user nova-compute[72929]:       <nova:ports>
Aug 26 21:59:46 user nova-compute[72929]:         <nova:port uuid="e55d4fb5-4832-428f-9379-faa4e3ffb801">
Aug 26 21:59:46 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 21:59:46 user nova-compute[72929]:         </nova:port>
Aug 26 21:59:46 user nova-compute[72929]:       </nova:ports>
Aug 26 21:59:46 user nova-compute[72929]:     </nova:instance>
Aug 26 21:59:46 user nova-compute[72929]:   </metadata>
Aug 26 21:59:46 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 21:59:46 user nova-compute[72929]:     <system>
Aug 26 21:59:46 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 21:59:46 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 21:59:46 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 21:59:46 user nova-compute[72929]:       <entry name="serial">5333d644-7490-4e03-ba39-63168ffd4d12</entry>
Aug 26 21:59:46 user nova-compute[72929]:       <entry name="uuid">5333d644-7490-4e03-ba39-63168ffd4d12</entry>
Aug 26 21:59:46 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 21:59:46 user nova-compute[72929]:     </system>
Aug 26 21:59:46 user nova-compute[72929]:   </sysinfo>
Aug 26 21:59:46 user nova-compute[72929]:   <os>
Aug 26 21:59:46 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 21:59:46 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 21:59:46 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 21:59:46 user nova-compute[72929]:   </os>
Aug 26 21:59:46 user nova-compute[72929]:   <features>
Aug 26 21:59:46 user nova-compute[72929]:     <acpi/>
Aug 26 21:59:46 user nova-compute[72929]:     <apic/>
Aug 26 21:59:46 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 21:59:46 user nova-compute[72929]:   </features>
Aug 26 21:59:46 user nova-compute[72929]:   <clock offset="utc">
Aug 26 21:59:46 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 21:59:46 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 21:59:46 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 21:59:46 user nova-compute[72929]:   </clock>
Aug 26 21:59:46 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 21:59:46 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 21:59:46 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 21:59:46 user nova-compute[72929]:   </cpu>
Aug 26 21:59:46 user nova-compute[72929]:   <devices>
Aug 26 21:59:46 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 21:59:46 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 21:59:46 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk"/>
Aug 26 21:59:46 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 21:59:46 user nova-compute[72929]:     </disk>
Aug 26 21:59:46 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 21:59:46 user nova-compute[72929]:       <mac address="fa:16:3e:72:ad:d9"/>
Aug 26 21:59:46 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:59:46 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 21:59:46 user nova-compute[72929]:       <target dev="tape55d4fb5-48"/>
Aug 26 21:59:46 user nova-compute[72929]:     </interface>
Aug 26 21:59:46 user nova-compute[72929]:     <serial type="pty">
Aug 26 21:59:46 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/console.log" append="off"/>
Aug 26 21:59:46 user nova-compute[72929]:     </serial>
Aug 26 21:59:46 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 21:59:46 user nova-compute[72929]:     <video>
Aug 26 21:59:46 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 21:59:46 user nova-compute[72929]:     </video>
Aug 26 21:59:46 user nova-compute[72929]:     <rng model="virtio">
Aug 26 21:59:46 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 21:59:46 user nova-compute[72929]:     </rng>
Aug 26 21:59:46 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 21:59:46 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 21:59:46 user nova-compute[72929]:       <stats period="10"/>
Aug 26 21:59:46 user nova-compute[72929]:     </memballoon>
Aug 26 21:59:46 user nova-compute[72929]:   </devices>
Aug 26 21:59:46 user nova-compute[72929]: </domain>
Aug 26 21:59:46 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-511598667',display_name='tempest-AttachVolumeNegativeTest-server-511598667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-511598667',id=12,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdsrCwmFngvQvYs2C/I+pyb5aQk0B1FLWBICiW3FCiW5N/0KTaFkIIpRK5Csx9EqXYzrR5zmuQG/a5/QzA5GfqZBOzKEd77xxE1gEvGoreWM1nAeBhlv7adDz2krVDkDA==',key_name='tempest-keypair-147163806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-7rgrtbdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=5333d644-7490-4e03-ba39-63168ffd4d12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG os_vif [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape55d4fb5-48, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape55d4fb5-48, col_values=(('external_ids', {'iface-id': 'e55d4fb5-4832-428f-9379-faa4e3ffb801', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:ad:d9', 'vm-uuid': '5333d644-7490-4e03-ba39-63168ffd4d12'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:46 user nova-compute[72929]: INFO os_vif [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48')
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:72:ad:d9, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Updated VIF entry in instance network info cache for port e55d4fb5-4832-428f-9379-faa4e3ffb801. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Updating instance_info_cache with network_info: [{"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d9e3c78a-c63f-4e22-9b78-31c3f4ea1d95 req-c366f8e0-ab99-4e15-8e60-bbee2c267763 service nova] Releasing lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c6e9a14-f67c-4815-9e3d-db3137b5c122 req-ecb10f34-fa81-46aa-a911-cb29f543b27c service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c6e9a14-f67c-4815-9e3d-db3137b5c122 req-ecb10f34-fa81-46aa-a911-cb29f543b27c service nova] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c6e9a14-f67c-4815-9e3d-db3137b5c122 req-ecb10f34-fa81-46aa-a911-cb29f543b27c service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c6e9a14-f67c-4815-9e3d-db3137b5c122 req-ecb10f34-fa81-46aa-a911-cb29f543b27c service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c6e9a14-f67c-4815-9e3d-db3137b5c122 req-ecb10f34-fa81-46aa-a911-cb29f543b27c service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] No waiting events found dispatching network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:48 user nova-compute[72929]: WARNING nova.compute.manager [req-6c6e9a14-f67c-4815-9e3d-db3137b5c122 req-ecb10f34-fa81-46aa-a911-cb29f543b27c service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received unexpected event network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 for instance with vm_state building and task_state spawning.
Aug 26 21:59:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087190.2405484, 5333d644-7490-4e03-ba39-63168ffd4d12 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] VM Resumed (Lifecycle Event)
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Instance spawned successfully.
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-bdc77677-ea23-4e39-8305-8e6be8dd48f4 req-dabd90c5-7dae-4f1a-b487-68ac44caf710 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdc77677-ea23-4e39-8305-8e6be8dd48f4 req-dabd90c5-7dae-4f1a-b487-68ac44caf710 service nova] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdc77677-ea23-4e39-8305-8e6be8dd48f4 req-dabd90c5-7dae-4f1a-b487-68ac44caf710 service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdc77677-ea23-4e39-8305-8e6be8dd48f4 req-dabd90c5-7dae-4f1a-b487-68ac44caf710 service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-bdc77677-ea23-4e39-8305-8e6be8dd48f4 req-dabd90c5-7dae-4f1a-b487-68ac44caf710 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] No waiting events found dispatching network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:50 user nova-compute[72929]: WARNING nova.compute.manager [req-bdc77677-ea23-4e39-8305-8e6be8dd48f4 req-dabd90c5-7dae-4f1a-b487-68ac44caf710 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received unexpected event network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 for instance with vm_state building and task_state spawning.
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087190.2420719, 5333d644-7490-4e03-ba39-63168ffd4d12 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] VM Started (Lifecycle Event)
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Took 5.82 seconds to spawn the instance on the hypervisor.
Aug 26 21:59:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:50 user nova-compute[72929]: INFO nova.compute.manager [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Took 7.00 seconds to build instance.
Aug 26 21:59:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c93a5604-b358-4a70-acfc-85d6a561ed57 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "5333d644-7490-4e03-ba39-63168ffd4d12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.110s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:51 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087176.5450473, 925086ad-8a40-40e1-a537-a00923a0dd3f => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:59:51 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] VM Stopped (Lifecycle Event)
Aug 26 21:59:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fcdbae92-cefe-4f61-ae94-90efc2b898b0 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-changed-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Refreshing instance network info cache due to event network-changed-2079e4a3-b51b-49d9-a227-899cbd486ae5. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] Acquiring lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] Acquired lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG nova.network.neutron [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Refreshing network info cache for port 2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIFAcbgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:52 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:52 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:52 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33a0eb7-d132-49a5-9e7e-26375bed23a1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:59:52 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[711789d7-294e-440c-bad6-ee69aafb2e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd] added
Aug 26 21:59:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087177.7570422, 32f5db95-9356-4feb-9dd8-44727cebdde0 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 21:59:52 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] VM Stopped (Lifecycle Event)
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb381c5-f577-4adb-af1e-29f8fe68af7e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b9ee0d59-09cc-4b14-9c8f-0d8fede464a9 None None] [instance: 32f5db95-9356-4feb-9dd8-44727cebdde0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9d89bd-52f7-4b77-8d3c-75fedcbfd464]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIFAcbgi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIFAcbgi" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e621169-83d6-45c3-b2d9-a89b7ac2254a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIFAcbgi'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[30715e39-63c9-4200-9efc-2f56d1db2c5d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63be3f7-05ff-4c6a-9217-0e4753f021cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:52 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:52 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29da1c71-86d5-4ead-983b-039390cb33b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260]
Aug 26 21:59:52 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260] successful.
Aug 26 21:59:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d40e57-f142-4f3c-ad66-1c7a7a9b7cbd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e0fe0-94d9-4873-bfbb-003ab8fa6496]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:53 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:53 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:53 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:53 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:53 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:53 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[923096de-fcf7-4b81-a627-d8b715ee452a]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "interface-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "interface-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'flavor' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updated VIF entry in instance network info cache for port 2079e4a3-b51b-49d9-a227-899cbd486ae5. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-49348acb-b5db-45eb-a2f5-75babfa1b2ad req-741db223-e573-41bc-aee6-4c2954aa8c21 service nova] Releasing lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'pci_requests' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.objects.base [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Object Instance<f2ae437b-0e1a-4f23-a1a8-56bd3280ed22> lazy-loaded attributes: flavor,pci_requests {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 21:59:53 user nova-compute[72929]: DEBUG nova.policy [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9347c20c29943a0ada7fbf255609767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '459f54f128ef4e719c81a1eb92eb817d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIFAcbgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23064326238343139', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064326238343139', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.objects.instance [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'flavor' on Instance uuid 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:59:54 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:59:54 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 21:59:54 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:59:54 user nova-compute[72929]:   <serial>17f49c79-3ca6-460a-87fe-da50ce8d05dd</serial>
Aug 26 21:59:54 user nova-compute[72929]: </disk>
Aug 26 21:59:54 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Successfully created port: db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No VIF found with MAC fa:16:3e:97:68:8b, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:59:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-333ccf64-6a4c-428a-9f56-235525089213 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.082s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Successfully updated port: db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquired lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-changed-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Refreshing instance network info cache due to event network-changed-db9db397-bc88-41cb-8df1-b0bfcfc21b12. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] Acquiring lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:55 user nova-compute[72929]: INFO nova.compute.manager [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Detaching volume 17f49c79-3ca6-460a-87fe-da50ce8d05dd
Aug 26 21:59:55 user nova-compute[72929]: INFO nova.virt.block_device [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Attempting to driver detach volume 17f49c79-3ca6-460a-87fe-da50ce8d05dd from mountpoint /dev/vdb
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Attempting to detach device vdb from instance 90e97032-f5f1-412a-b74a-50528262e6d8 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:59:55 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:59:55 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 21:59:55 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:59:55 user nova-compute[72929]:   <serial>17f49c79-3ca6-460a-87fe-da50ce8d05dd</serial>
Aug 26 21:59:55 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:59:55 user nova-compute[72929]: </disk>
Aug 26 21:59:55 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:59:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Successfully detached device vdb from instance 90e97032-f5f1-412a-b74a-50528262e6d8 from the persistent domain config.
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90e97032-f5f1-412a-b74a-50528262e6d8 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 21:59:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 21:59:55 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:59:55 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 21:59:55 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 21:59:55 user nova-compute[72929]:   <serial>17f49c79-3ca6-460a-87fe-da50ce8d05dd</serial>
Aug 26 21:59:55 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 21:59:55 user nova-compute[72929]: </disk>
Aug 26 21:59:55 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpwcOHrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:56 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:56 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:56 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Releasing lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] Acquired lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Refreshing network info cache for port db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a30152-fda0-43fb-9caf-a6d913270966]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 21:59:56 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_vif [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb9db397-bc, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb9db397-bc, col_values=(('external_ids', {'iface-id': 'db9db397-bc88-41cb-8df1-b0bfcfc21b12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:89:0c', 'vm-uuid': 'f2ae437b-0e1a-4f23-a1a8-56bd3280ed22'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab90eaf4-3095-405d-8c8b-9ee73cbaed3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9] added
Aug 26 21:59:56 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:56 user nova-compute[72929]: INFO os_vif [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc')
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] attach device xml: <interface type="ethernet">
Aug 26 21:59:56 user nova-compute[72929]:   <mac address="fa:16:3e:e5:89:0c"/>
Aug 26 21:59:56 user nova-compute[72929]:   <model type="virtio"/>
Aug 26 21:59:56 user nova-compute[72929]:   <mtu size="1442"/>
Aug 26 21:59:56 user nova-compute[72929]:   <target dev="tapdb9db397-bc"/>
Aug 26 21:59:56 user nova-compute[72929]: </interface>
Aug 26 21:59:56 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc542f3-bde0-40ef-85d8-3ca32ddb73b4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ad8181-879d-40b8-9d70-8c4dea629905]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpwcOHrQ {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpwcOHrQ" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2566ce7c-9642-48a5-a44e-05a018aa380a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tpwcOHrQ'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5de3aa-e05f-481f-a08b-9da77a6806e0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b7a3ff-d703-4eda-9ce8-54e4e91becce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:56 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:56 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087196.4806497, 90e97032-f5f1-412a-b74a-50528262e6d8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 21:59:56 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Successfully detached device vdb from instance 90e97032-f5f1-412a-b74a-50528262e6d8 from the live domain config.
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIFAcbgi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:56 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[51283798-839f-4769-85f3-ddf61170a716]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260]
Aug 26 21:59:56 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260] successful.
Aug 26 21:59:56 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6be960-0d08-4795-a642-b41fc5f5150d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef59f36-c1e1-46dc-aafa-66d8e8ed2cb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 21:59:56 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:56 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 21:59:56 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dc69f7-8edd-418e-b102-6aec91159665]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpwcOHrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No BDM found with device name hda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No VIF found with MAC fa:16:3e:b6:39:dd, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 21:59:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 21:59:56 user nova-compute[72929]:   <nova:package version="0.0.0"/>
Aug 26 21:59:56 user nova-compute[72929]:   <nova:name>tempest-device-tagging-server-1426573410</nova:name>
Aug 26 21:59:56 user nova-compute[72929]:   <nova:creationTime>2023-08-26 21:59:56</nova:creationTime>
Aug 26 21:59:56 user nova-compute[72929]:   <nova:flavor name="m1.tiny">
Aug 26 21:59:56 user nova-compute[72929]:     <nova:memory>512</nova:memory>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:disk>1</nova:disk>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:swap>0</nova:swap>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:vcpus>1</nova:vcpus>
Aug 26 21:59:56 user nova-compute[72929]:   </nova:flavor>
Aug 26 21:59:56 user nova-compute[72929]:   <nova:owner>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:user uuid="b9347c20c29943a0ada7fbf255609767">tempest-TaggedAttachmentsTest-1623013215-project-member</nova:user>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:project uuid="459f54f128ef4e719c81a1eb92eb817d">tempest-TaggedAttachmentsTest-1623013215</nova:project>
Aug 26 21:59:56 user nova-compute[72929]:   </nova:owner>
Aug 26 21:59:56 user nova-compute[72929]:   <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 21:59:56 user nova-compute[72929]:   <nova:ports>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:port uuid="2079e4a3-b51b-49d9-a227-899cbd486ae5">
Aug 26 21:59:56 user nova-compute[72929]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 21:59:56 user nova-compute[72929]:     </nova:port>
Aug 26 21:59:56 user nova-compute[72929]:     <nova:port uuid="db9db397-bc88-41cb-8df1-b0bfcfc21b12">
Aug 26 21:59:56 user nova-compute[72929]:       <nova:ip type="fixed" address="10.10.10.8" ipVersion="4"/>
Aug 26 21:59:56 user nova-compute[72929]:     </nova:port>
Aug 26 21:59:56 user nova-compute[72929]:   </nova:ports>
Aug 26 21:59:56 user nova-compute[72929]: </nova:instance>
Aug 26 21:59:56 user nova-compute[72929]:  {{(pid=72929) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dca6b139-9108-43b7-8e79-0c650235c968 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "interface-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.828s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updated VIF entry in instance network info cache for port db9db397-bc88-41cb-8df1-b0bfcfc21b12. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e9c92d2-eb64-4dc5-824c-a6853559daa2 req-bcbe5fda-bd57-4f49-ae09-7c12494719f5 service nova] Releasing lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'flavor' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:57 user nova-compute[72929]: WARNING nova.compute.manager [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 for instance with vm_state active and task_state None.
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 21:59:57 user nova-compute[72929]: WARNING nova.compute.manager [req-bf7040b7-59f9-4e8a-b2a9-7c996a8ef236 req-a08b9186-e430-4002-885b-8b9fbc470dc4 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 for instance with vm_state active and task_state None.
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 21:59:57 user nova-compute[72929]: INFO nova.compute.manager [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Attaching volume 8ab490e8-53c5-450f-a257-8db99de9750c to /dev/vdb
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '23635323138363138', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635323138363138', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.135s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lazy-loading 'flavor' on Instance uuid 86b0db90-8909-4572-8d40-888dc5151698 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.utils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15c6a9c-69e6-487f-a87e-a2dcbf881b24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8f690a-5d9f-4449-bce8-ed36b794bbcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 21:59:57 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 21:59:57 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 21:59:57 user nova-compute[72929]:   <target dev="sdc" bus="scsi"/>
Aug 26 21:59:57 user nova-compute[72929]:   <serial>64fe871f-c73d-45a2-a618-2f6ba1dd27c9</serial>
Aug 26 21:59:57 user nova-compute[72929]:   <address type="drive" controller="0" unit="2"/>
Aug 26 21:59:57 user nova-compute[72929]: </disk>
Aug 26 21:59:57 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d582467-ff34-47c6-8e1e-1d46463ff3a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:57 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:57 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:57 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 21:59:57 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 21:59:57 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 21:59:57 user nova-compute[72929]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd (non-flash)
Aug 26 21:59:57 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 21:59:57 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b98128790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[99769579-f6d3-4863-8e45-7c36aedb9f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d105ddd6-5143-4560-8d64-244df3a6ccf7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83a83b3-1605-4fb1-bd79-adf96f893779]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb6dd9e-92f9-4338-afb8-9a016dd21e05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ab40f-3ca6-4734-a75f-e8baa4cbdff3]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 21:59:57 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[006aa08b-56c0-41d0-8291-853205545ea2]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a1759-a54a-47e2-8bdc-1e190297de61]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.utils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating existing volume attachment record: 1e1b94a1-0aa4-428a-95f1-d4fd576b66e1 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.125s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ba6e51-662e-4665-abd1-0b0dd1599c8b]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 21:59:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.121s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8546dbc9-65f0-466e-a444-e98279fcbb23]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[11879325-2e67-4def-bf38-055f5049f480]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260]
Aug 26 21:59:58 user nova-compute[72929]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd, portal: 172.16.0.220,3260] successful.
Aug 26 21:59:58 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f49c79-3ca6-460a-87fe-da50ce8d05dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6bf1e1-0b88-4bbc-ab48-c24c23624341]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.578s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] <== disconnect_volume: return (1713ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No BDM found with device name sda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 21:59:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] No VIF found with MAC fa:16:3e:0d:9d:ae, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-changed-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Refreshing instance network info cache due to event network-changed-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:00:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] Acquiring lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] Acquired lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Refreshing network info cache for port abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:00:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updated VIF entry in instance network info cache for port abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:00:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updating instance_info_cache with network_info: [{"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8a649e3-ec6c-429c-b101-66b01f555e33 req-5e8a6345-9568-4e95-bf80-8f514ad30536 service nova] Releasing lock "refresh_cache-67091d20-1923-4efb-92eb-f11df34f85e6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-changed-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Refreshing instance network info cache due to event network-changed-6d0845c8-db04-4979-8dc2-3e60a8b3536b. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:00:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] Acquiring lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] Acquired lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Refreshing network info cache for port 6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:00:10 user nova-compute[72929]: DEBUG nova.network.neutron [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updated VIF entry in instance network info cache for port 6d0845c8-db04-4979-8dc2-3e60a8b3536b. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:00:10 user nova-compute[72929]: DEBUG nova.network.neutron [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updating instance_info_cache with network_info: [{"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-392a4a00-ea56-44b7-b1f1-ac60fc76f8a9 req-3e56a8c1-4950-4c3b-89b0-4ca3734e112f service nova] Releasing lock "refresh_cache-8555f690-3843-4989-8d93-2bf3ce87e8ef" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:10 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d271f935-4c5e-4c43-a7f0-1fb0bcd60a81 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.674s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lazy-loading 'flavor' on Instance uuid 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'flavor' on Instance uuid 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0b753d90-abb9-4695-9eef-57635135a7bc tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 15.766s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:00:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Creating image(s)
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Ensure instance console log exists: /opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Start _get_guest_xml network_info=[{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'dabf29a5-e923-4329-b29a-e349413baaa4', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfWJwNRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8', 'attached_at': '', 'detached_at': '', 'volume_id': '136d902b-c078-43d7-9b3f-80b38442bec1', 'serial': '136d902b-c078-43d7-9b3f-80b38442bec1'}, 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '47ef67cc-5792-48cb-a289-ddbc64624728', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtJLWrgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7046cf6-d3ae-4109-bfce-b6278ac12340', 'serial': 'e7046cf6-d3ae-4109-bfce-b6278ac12340'}, 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'b0b60377-8147-4bee-8529-186311cdb29e', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhqNAFUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8', 'attached_at': '', 'detached_at': '', 'volume_id': '5f7f1008-22bb-4a2c-bfdd-f066cd82c35a', 'serial': '5f7f1008-22bb-4a2c-bfdd-f066cd82c35a'}, 'boot_index': 2, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOkfKxvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:11 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:11 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:11 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:11 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfWJwNRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:11 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3913496-9bc2-466c-ab8a-08560878aea2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:11 user nova-compute[72929]: INFO nova.compute.manager [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Attaching volume 71db5fb4-7c40-4612-be5c-12b7e3d0a55f to /dev/vdb
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:00:11 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[30005f65-13a7-44ea-962c-3665d8bb77e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c] added
Aug 26 22:00:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7904471b-d121-49a8-b20c-d9efe9746640]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.utils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d8ebf8-aa8d-413a-a216-66ad1dbc5aa0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOkfKxvw {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81c08be-793c-4bb1-8df4-b3dc77990416]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mOkfKxvw" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d94bf6-3037-4c41-8fdd-e7f955082bdd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mOkfKxvw'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[caafed4d-2710-4da5-9756-883296f0d687]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ec98a-8add-4758-80d1-58cc82f70718]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf5dd12-0790-4efa-82ab-798879552057]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc889c4-28eb-41d8-bda5-0e9be62ebc84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[21422668-eb13-4202-ab8e-ba18cf019b57]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:00:12 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[69223b1d-2726-462f-9d11-3643fb0268e4]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.utils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updating existing volume attachment record: fe56315a-52a9-4314-8b8d-a7f3f6138460 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5662bfb-dbb0-4738-963e-9b3d827389a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260]
Aug 26 22:00:12 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:12 user nova-compute[72929]: INFO nova.compute.manager [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Detaching volume 64fe871f-c73d-45a2-a618-2f6ba1dd27c9
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd909067-c2d6-4e3c-8e60-b39dd7b266fb]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[569dc2c7-b50e-4572-9766-629346e12a00]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:12 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe892909-3ea0-4d11-8169-4b15d3941106]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:12 user nova-compute[72929]: INFO nova.virt.block_device [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Attempting to driver detach volume 64fe871f-c73d-45a2-a618-2f6ba1dd27c9 from mountpoint /dev/sdc
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Attempting to detach device sdc from instance 86b0db90-8909-4572-8d40-888dc5151698 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:00:12 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:12 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:00:12 user nova-compute[72929]:   <target dev="sdc" bus="scsi"/>
Aug 26 22:00:12 user nova-compute[72929]:   <serial>64fe871f-c73d-45a2-a618-2f6ba1dd27c9</serial>
Aug 26 22:00:12 user nova-compute[72929]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 22:00:12 user nova-compute[72929]: </disk>
Aug 26 22:00:12 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Successfully detached device sdc from instance 86b0db90-8909-4572-8d40-888dc5151698 from the persistent domain config.
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 86b0db90-8909-4572-8d40-888dc5151698 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:00:12 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:12 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:00:12 user nova-compute[72929]:   <target dev="sdc" bus="scsi"/>
Aug 26 22:00:12 user nova-compute[72929]:   <serial>64fe871f-c73d-45a2-a618-2f6ba1dd27c9</serial>
Aug 26 22:00:12 user nova-compute[72929]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 26 22:00:12 user nova-compute[72929]: </disk>
Aug 26 22:00:12 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:12 user nova-compute[72929]: INFO nova.compute.manager [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Rebuilding instance
Aug 26 22:00:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087212.6527412, 86b0db90-8909-4572-8d40-888dc5151698 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 86b0db90-8909-4572-8d40-888dc5151698 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:00:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Successfully detached device sdc from instance 86b0db90-8909-4572-8d40-888dc5151698 from the live domain config.
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpwcOHrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:12 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-c7d218ef-17d5-4369-b8cf-68b2ddd5315e req-6820a5a9-5738-4de4-94fa-a9d99a86f3f6 service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-vif-unplugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c7d218ef-17d5-4369-b8cf-68b2ddd5315e req-6820a5a9-5738-4de4-94fa-a9d99a86f3f6 service nova] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c7d218ef-17d5-4369-b8cf-68b2ddd5315e req-6820a5a9-5738-4de4-94fa-a9d99a86f3f6 service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c7d218ef-17d5-4369-b8cf-68b2ddd5315e req-6820a5a9-5738-4de4-94fa-a9d99a86f3f6 service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-c7d218ef-17d5-4369-b8cf-68b2ddd5315e req-6820a5a9-5738-4de4-94fa-a9d99a86f3f6 service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] No waiting events found dispatching network-vif-unplugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:13 user nova-compute[72929]: WARNING nova.compute.manager [req-c7d218ef-17d5-4369-b8cf-68b2ddd5315e req-6820a5a9-5738-4de4-94fa-a9d99a86f3f6 service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received unexpected event network-vif-unplugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b for instance with vm_state active and task_state rebuilding.
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOkfKxvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26464313935343234', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464313935343234', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.414s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:13 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:13 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'flavor' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4740f2b-f21f-42d1-a6ab-36e01e82cfee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:00:13 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c12d81-9c2c-4792-9c88-f329698e7def]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1] added
Aug 26 22:00:13 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:00:13 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:13 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:00:13 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:00:13 user nova-compute[72929]:   <serial>8ab490e8-53c5-450f-a257-8db99de9750c</serial>
Aug 26 22:00:13 user nova-compute[72929]: </disk>
Aug 26 22:00:13 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[770c4633-2a39-43e1-9bc2-b13f216b868b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e71d83-a8f0-4998-9220-40f696c7100e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfWJwNRe {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cfWJwNRe" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dbcd86-7e28-42e1-8196-94cdbcd6e792]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cfWJwNRe'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd16388-b80a-4d99-8abc-f55b18d85079]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.119s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[128fe530-dc48-4ab8-9e7b-b02215142244]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:13 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:13 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba63254-2e4c-4fa4-a19b-6a7ceef86e69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260]
Aug 26 22:00:13 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:13 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c466d-dbba-458b-8dd4-9ced099b4e82]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf1cda-9796-4be3-89a5-d24493d40bd9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:13 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:13 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.473s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e24c1ad-b683-44d9-ad14-26659ffab397]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfWJwNRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:00:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance destroyed successfully.
Aug 26 22:00:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance destroyed successfully.
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1505589036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1555387934',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxtD5PEaYK9WFv6hquI4w9DEU2Etd046Y+IFfw3MuWoajH3d8UBwNYEvO/enwLXuvZXfthk8hdZ1Ix0bWudI0PJYcAR0Uw9oRkzFP0iWwLTAgbAwO2VzaGd7ci8aoeU1w==',key_name='tempest-keypair-916840740',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9d7fb7f0afaa4a57a7fb9bd4e4a41f5e',ramdisk_id='',reservation_id='r-xl9uw4da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-550646581',owner_user_name='tempest-ServerActionsV293TestJSON-550646581-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c14a8b7c012414ca17ec7ed1630ac02',uuid=8555f690-3843-4989-8d93-2bf3ce87e8ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converting VIF {"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_vif [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d0845c8-db, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:14 user nova-compute[72929]: INFO os_vif [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db')
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWFRKoqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:14 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No BDM found with device name hda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] No VIF found with MAC fa:16:3e:b6:39:dd, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4270c61f-2383-4acf-b336-ab331053988d tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.706s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updating instance_info_cache with network_info: [{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== connect_volume: return (2933ms) {'type': 'block', 'scsi_wwn': '26630336635346661', 'path': '/dev/sdf'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630336635346661', 'path': '/dev/sdf'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.084s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[386fd5bd-f6d0-4528-b18c-615ee75dc793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtJLWrgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:14 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae18fe4-0236-435e-9e96-f82f6cdbc0bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:14 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba68e28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded31bde-6cfc-46f7-ad4a-cc2a02ba2d67]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[34da407b-f8e3-4d71-9c0e-eae1b22b941c]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067bdfb-3493-49d2-8a40-29e36d88e757]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13d91a3-7b3d-48d8-9a9d-e6f9aa6de25b]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:00:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[65974650-3a95-4488-8edf-84cc0d280297]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dff53c-f7b0-4989-9c5e-61769cc5a57f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260]
Aug 26 22:00:15 user nova-compute[72929]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fe871f-c73d-45a2-a618-2f6ba1dd27c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf20f8de-f3d2-42d2-ae8d-d705235e851b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] <== disconnect_volume: return (2451ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.060s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-53d122b8-b77d-4052-9dbe-83ed2d99b913 req-fff1ef60-fb43-49b7-95e6-e0b62f954e95 service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-53d122b8-b77d-4052-9dbe-83ed2d99b913 req-fff1ef60-fb43-49b7-95e6-e0b62f954e95 service nova] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-53d122b8-b77d-4052-9dbe-83ed2d99b913 req-fff1ef60-fb43-49b7-95e6-e0b62f954e95 service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-53d122b8-b77d-4052-9dbe-83ed2d99b913 req-fff1ef60-fb43-49b7-95e6-e0b62f954e95 service nova] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-53d122b8-b77d-4052-9dbe-83ed2d99b913 req-fff1ef60-fb43-49b7-95e6-e0b62f954e95 service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] No waiting events found dispatching network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:15 user nova-compute[72929]: WARNING nova.compute.manager [req-53d122b8-b77d-4052-9dbe-83ed2d99b913 req-fff1ef60-fb43-49b7-95e6-e0b62f954e95 service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received unexpected event network-vif-plugged-6d0845c8-db04-4979-8dc2-3e60a8b3536b for instance with vm_state active and task_state rebuilding.
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d55b8f5-f953-494f-89f1-a198ee3c807f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a5329-d74a-4988-b2c2-9418492d7e24]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba67f0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca3682-8def-4ae1-914e-4cc647de853a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0319c9d-a2d9-45ce-9914-7c26414d4045]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdada24-d1fd-42d5-96f5-3775024cfe03]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c0eb8-b0f5-4199-9f8a-bd80915aad18]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f997dc-5775-439a-81bd-e39863ebdc16]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f1892-4018-446d-9062-a5833bcdf6d5]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260]
Aug 26 22:00:15 user nova-compute[72929]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dff2aff-f5f1-45a3-844b-83c742f24462]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] <== disconnect_volume: return (1412ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:00:15 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Deleting instance files /opt/stack/data/nova/instances/8555f690-3843-4989-8d93-2bf3ce87e8ef_del
Aug 26 22:00:15 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Deletion of /opt/stack/data/nova/instances/8555f690-3843-4989-8d93-2bf3ce87e8ef_del complete
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.709s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:15 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:15 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca96e3f-df61-4894-a217-d19afca93a0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:00:15 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0968ccde-9162-46db-a367-48758f2e74cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340] added
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13235a2-4b5f-4e30-9a2c-8f01fa5aafac]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819c70b-af97-44b9-9eeb-30f362359205]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtJLWrgx {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wtJLWrgx" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3622f-955a-4475-b3f2-ad381cd5e4a8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wtJLWrgx'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: INFO nova.compute.manager [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Detaching volume 8ab490e8-53c5-450f-a257-8db99de9750c
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a05b03-58a5-44ef-8807-5e6b78c0400a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c15e2-5d40-4e76-9d43-895c9987e6c8]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef could not be found.
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWFRKoqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:15 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a0b36b-ea47-4c9b-a8fe-37f1fd3ef7c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260]
Aug 26 22:00:15 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf546210-d65b-4c0e-80a1-fb16ff6fd179]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: INFO nova.virt.block_device [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Attempting to driver detach volume 8ab490e8-53c5-450f-a257-8db99de9750c from mountpoint /dev/vdb
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac47c66c-78ff-458b-8969-8c7b179378c5]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Attempting to detach device vdb from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:00:15 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:15 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:00:15 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:00:15 user nova-compute[72929]:   <serial>8ab490e8-53c5-450f-a257-8db99de9750c</serial>
Aug 26 22:00:15 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 22:00:15 user nova-compute[72929]: </disk>
Aug 26 22:00:15 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:00:15 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully detached device vdb from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the persistent domain config.
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:00:15 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:15 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:00:15 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:00:15 user nova-compute[72929]:   <serial>8ab490e8-53c5-450f-a257-8db99de9750c</serial>
Aug 26 22:00:15 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 22:00:15 user nova-compute[72929]: </disk>
Aug 26 22:00:15 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a7fd95-8d4d-4ba2-b5d9-dad5a746228a]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087216.3610666, f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:00:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully detached device vdb from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the live domain config.
Aug 26 22:00:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mOkfKxvw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtJLWrgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== connect_volume: return (2156ms) {'type': 'block', 'scsi_wwn': '23630353964396431', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630353964396431', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.162s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eae489-a7b0-4008-bf0b-952b3077716f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhqNAFUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:17 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e9346f-f143-40a7-ae07-b641a95ffd87]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b982edea0>, {}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Disconnecting from: [] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] <== disconnect_volume: return (1222ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.649s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[015756a8-6c22-4d62-b148-73455b266db8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b42d76b-3ab9-45cb-8139-1d4a6a711217]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba67f0790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[532f19b7-973f-4be0-86b8-3f1d8d806308]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[976a877f-62e2-40be-bce3-8125b66eb50b]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7dc095-c597-44d0-a614-5ff124c2b259]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f97482b-f5c0-4adc-9146-f79d63f503c7]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ada455c-b619-4bbb-ad74-395829c1456b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[354203b1-976c-491c-8d33-38ac69bc0681]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260]
Aug 26 22:00:17 user nova-compute[72929]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ab490e8-53c5-450f-a257-8db99de9750c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf15e6f-d607-49e5-b7a4-0360fef4b970]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] <== disconnect_volume: return (1003ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.378s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:17 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:17 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7a9932-0354-4a33-a1f0-51d1e35aff9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:00:17 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d79e1b-0b26-4728-9f1f-eb8c41b3c284]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a] added
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf231202-ab00-4b31-97ee-20b9bc53001b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed86bce-8059-4bbf-b5dd-1c0920e9d0ac]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhqNAFUk {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhqNAFUk" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc03875-1eb4-4ba7-9606-465ded8f22fd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bhqNAFUk'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de00d82-fd0a-4ed1-b941-8170cc3c552e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be89c01-b266-4159-b363-557a6431205a]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a496e9-897d-4657-bad1-2bce01ddaff9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260]
Aug 26 22:00:17 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5d3125-9e55-4419-bff4-90a99ce2ca2c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd65bc-52ba-4c1e-8e76-9d7e9a21b981]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f174b-d244-4864-a0a4-c31fa061be69]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhqNAFUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Preparing to wait for external event volume-reimaged-f6720532-a4f1-4993-b026-4dac16524e10 {{(pid=72929) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '8555f690-3843-4989-8d93-2bf3ce87e8ef' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '8555f690-3843-4989-8d93-2bf3ce87e8ef' (instance-0000000a)
Aug 26 22:00:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== connect_volume: return (1837ms) {'type': 'block', 'scsi_wwn': '23062333138346266', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062333138346266', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:00:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7249MB free_disk=24.470577239990234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lazy-loading 'pci_devices' on Instance uuid 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:00:18 user nova-compute[72929]:   <uuid>16208bfb-7bef-44b7-bf18-d5ce38e31fa8</uuid>
Aug 26 22:00:18 user nova-compute[72929]:   <name>instance-0000000b</name>
Aug 26 22:00:18 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:00:18 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:00:18 user nova-compute[72929]:   <metadata>
Aug 26 22:00:18 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:00:18 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:00:18 user nova-compute[72929]:       <nova:name>tempest-device-tagging-server-706041319</nova:name>
Aug 26 22:00:18 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:00:11</nova:creationTime>
Aug 26 22:00:18 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:00:18 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:00:18 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:00:18 user nova-compute[72929]:       <nova:owner>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:user uuid="cafed116bbc9411dbff17af1b2b34792">tempest-TaggedBootDevicesTest-2081995986-project-member</nova:user>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:project uuid="457688283de340618fb3506750a7c737">tempest-TaggedBootDevicesTest-2081995986</nova:project>
Aug 26 22:00:18 user nova-compute[72929]:       </nova:owner>
Aug 26 22:00:18 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:00:18 user nova-compute[72929]:       <nova:ports>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="d359e5a7-2499-40d3-9b7c-e269a2120ade">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="171a196d-bcf5-4522-a18a-e5b7267a67f2">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="e61229de-f1d1-4f96-8f3c-e4cae5e871b0">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.125" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="0d9eb10a-c2b8-438e-9e48-c58fb2e72098">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.209" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="2b7e5c06-a545-4009-a95f-dae7ecee44f6">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="71b71ee5-cff0-495d-a247-75f7252edba0">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:         <nova:port uuid="d2a82b2b-f386-45ff-9108-ee0597716cb1">
Aug 26 22:00:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 22:00:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:18 user nova-compute[72929]:       </nova:ports>
Aug 26 22:00:18 user nova-compute[72929]:     </nova:instance>
Aug 26 22:00:18 user nova-compute[72929]:   </metadata>
Aug 26 22:00:18 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:00:18 user nova-compute[72929]:     <system>
Aug 26 22:00:18 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:00:18 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:00:18 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:00:18 user nova-compute[72929]:       <entry name="serial">16208bfb-7bef-44b7-bf18-d5ce38e31fa8</entry>
Aug 26 22:00:18 user nova-compute[72929]:       <entry name="uuid">16208bfb-7bef-44b7-bf18-d5ce38e31fa8</entry>
Aug 26 22:00:18 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:00:18 user nova-compute[72929]:     </system>
Aug 26 22:00:18 user nova-compute[72929]:   </sysinfo>
Aug 26 22:00:18 user nova-compute[72929]:   <os>
Aug 26 22:00:18 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:00:18 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:00:18 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:00:18 user nova-compute[72929]:   </os>
Aug 26 22:00:18 user nova-compute[72929]:   <features>
Aug 26 22:00:18 user nova-compute[72929]:     <acpi/>
Aug 26 22:00:18 user nova-compute[72929]:     <apic/>
Aug 26 22:00:18 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:00:18 user nova-compute[72929]:   </features>
Aug 26 22:00:18 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:00:18 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:00:18 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:00:18 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:00:18 user nova-compute[72929]:   </clock>
Aug 26 22:00:18 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:00:18 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:00:18 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:00:18 user nova-compute[72929]:   </cpu>
Aug 26 22:00:18 user nova-compute[72929]:   <devices>
Aug 26 22:00:18 user nova-compute[72929]:     <disk type="file" device="cdrom">
Aug 26 22:00:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 22:00:18 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8/disk.config"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="hda" bus="ide"/>
Aug 26 22:00:18 user nova-compute[72929]:     </disk>
Aug 26 22:00:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:00:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:18 user nova-compute[72929]:       <source dev="/dev/sdf"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <serial>136d902b-c078-43d7-9b3f-80b38442bec1</serial>
Aug 26 22:00:18 user nova-compute[72929]:     </disk>
Aug 26 22:00:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:00:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:18 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <serial>e7046cf6-d3ae-4109-bfce-b6278ac12340</serial>
Aug 26 22:00:18 user nova-compute[72929]:     </disk>
Aug 26 22:00:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:00:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:18 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="vdc" bus="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <serial>5f7f1008-22bb-4a2c-bfdd-f066cd82c35a</serial>
Aug 26 22:00:18 user nova-compute[72929]:     </disk>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:c6:30:45"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tapd359e5a7-24"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:a5:33:00"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tap171a196d-bc"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:ab:0b:aa"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tape61229de-f1"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:e6:c5:c4"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tap0d9eb10a-c2"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:08:0e:57"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tap2b7e5c06-a5"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:b2:ed:d4"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tap71b71ee5-cf"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:18 user nova-compute[72929]:       <mac address="fa:16:3e:4f:2c:4c"/>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:18 user nova-compute[72929]:       <target dev="tapd2a82b2b-f3"/>
Aug 26 22:00:18 user nova-compute[72929]:     </interface>
Aug 26 22:00:18 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:00:18 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8/console.log" append="off"/>
Aug 26 22:00:18 user nova-compute[72929]:     </serial>
Aug 26 22:00:18 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:00:18 user nova-compute[72929]:     <video>
Aug 26 22:00:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:18 user nova-compute[72929]:     </video>
Aug 26 22:00:18 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:00:18 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:00:18 user nova-compute[72929]:     </rng>
Aug 26 22:00:18 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:00:18 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:00:18 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:00:18 user nova-compute[72929]:     </memballoon>
Aug 26 22:00:18 user nova-compute[72929]:   </devices>
Aug 26 22:00:18 user nova-compute[72929]: </domain>
Aug 26 22:00:18 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd359e5a7-24, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd359e5a7-24, col_values=(('external_ids', {'iface-id': 'd359e5a7-2499-40d3-9b7c-e269a2120ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:30:45', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap171a196d-bc, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap171a196d-bc, col_values=(('external_ids', {'iface-id': '171a196d-bcf5-4522-a18a-e5b7267a67f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:33:00', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'flavor' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape61229de-f1, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape61229de-f1, col_values=(('external_ids', {'iface-id': 'e61229de-f1d1-4f96-8f3c-e4cae5e871b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:0b:aa', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 90e97032-f5f1-412a-b74a-50528262e6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 86b0db90-8909-4572-8d40-888dc5151698 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 67091d20-1923-4efb-92eb-f11df34f85e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5333d644-7490-4e03-ba39-63168ffd4d12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d9eb10a-c2, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d9eb10a-c2, col_values=(('external_ids', {'iface-id': '0d9eb10a-c2b8-438e-9e48-c58fb2e72098', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:c5:c4', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e08d1694-169c-4bb3-9b4f-f94541d49674 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.458s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b7e5c06-a5, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b7e5c06-a5, col_values=(('external_ids', {'iface-id': '2b7e5c06-a545-4009-a95f-dae7ecee44f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:0e:57', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71b71ee5-cf, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71b71ee5-cf, col_values=(('external_ids', {'iface-id': '71b71ee5-cff0-495d-a247-75f7252edba0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ed:d4', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "interface-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-db9db397-bc88-41cb-8df1-b0bfcfc21b12" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "interface-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-db9db397-bc88-41cb-8df1-b0bfcfc21b12" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2a82b2b-f3, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2a82b2b-f3, col_values=(('external_ids', {'iface-id': 'd2a82b2b-f386-45ff-9108-ee0597716cb1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:2c:4c', 'vm-uuid': '16208bfb-7bef-44b7-bf18-d5ce38e31fa8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'flavor' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:89:0c"/><model type="virtio"/><mtu size="1442"/><target dev="tapdb9db397-bc"/></interface> {{(pid=72929) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:89:0c"/><model type="virtio"/><mtu size="1442"/><target dev="tapdb9db397-bc"/></interface> {{(pid=72929) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Attempting to detach device tapdb9db397-bc from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] detach device xml: <interface type="ethernet">
Aug 26 22:00:19 user nova-compute[72929]:   <mac address="fa:16:3e:e5:89:0c"/>
Aug 26 22:00:19 user nova-compute[72929]:   <model type="virtio"/>
Aug 26 22:00:19 user nova-compute[72929]:   <mtu size="1442"/>
Aug 26 22:00:19 user nova-compute[72929]:   <target dev="tapdb9db397-bc"/>
Aug 26 22:00:19 user nova-compute[72929]: </interface>
Aug 26 22:00:19 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: INFO os_vif [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3')
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:89:0c"/><model type="virtio"/><mtu size="1442"/><target dev="tapdb9db397-bc"/></interface> {{(pid=72929) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:89:0c"/><model type="virtio"/><mtu size="1442"/><target dev="tapdb9db397-bc"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 22:00:19 user nova-compute[72929]:   <name>instance-00000008</name>
Aug 26 22:00:19 user nova-compute[72929]:   <uuid>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</uuid>
Aug 26 22:00:19 user nova-compute[72929]:   <metadata>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:00:19 user nova-compute[72929]:   <nova:package version="0.0.0"/>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:name>tempest-device-tagging-server-1426573410</nova:name>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:creationTime>2023-08-26 21:59:56</nova:creationTime>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:flavor name="m1.tiny">
Aug 26 22:00:19 user nova-compute[72929]:     <nova:memory>512</nova:memory>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:disk>1</nova:disk>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:swap>0</nova:swap>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:vcpus>1</nova:vcpus>
Aug 26 22:00:19 user nova-compute[72929]:   </nova:flavor>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:owner>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:user uuid="b9347c20c29943a0ada7fbf255609767">tempest-TaggedAttachmentsTest-1623013215-project-member</nova:user>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:project uuid="459f54f128ef4e719c81a1eb92eb817d">tempest-TaggedAttachmentsTest-1623013215</nova:project>
Aug 26 22:00:19 user nova-compute[72929]:   </nova:owner>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:ports>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:port uuid="2079e4a3-b51b-49d9-a227-899cbd486ae5">
Aug 26 22:00:19 user nova-compute[72929]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 22:00:19 user nova-compute[72929]:     </nova:port>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:port uuid="db9db397-bc88-41cb-8df1-b0bfcfc21b12">
Aug 26 22:00:19 user nova-compute[72929]:       <nova:ip type="fixed" address="10.10.10.8" ipVersion="4"/>
Aug 26 22:00:19 user nova-compute[72929]:     </nova:port>
Aug 26 22:00:19 user nova-compute[72929]:   </nova:ports>
Aug 26 22:00:19 user nova-compute[72929]: </nova:instance>
Aug 26 22:00:19 user nova-compute[72929]:   </metadata>
Aug 26 22:00:19 user nova-compute[72929]:   <memory unit='KiB'>524288</memory>
Aug 26 22:00:19 user nova-compute[72929]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 22:00:19 user nova-compute[72929]:   <vcpu placement='static'>1</vcpu>
Aug 26 22:00:19 user nova-compute[72929]:   <resource>
Aug 26 22:00:19 user nova-compute[72929]:     <partition>/machine</partition>
Aug 26 22:00:19 user nova-compute[72929]:   </resource>
Aug 26 22:00:19 user nova-compute[72929]:   <sysinfo type='smbios'>
Aug 26 22:00:19 user nova-compute[72929]:     <system>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='version'>0.0.0</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='serial'>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='uuid'>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='family'>Virtual Machine</entry>
Aug 26 22:00:19 user nova-compute[72929]:     </system>
Aug 26 22:00:19 user nova-compute[72929]:   </sysinfo>
Aug 26 22:00:19 user nova-compute[72929]:   <os>
Aug 26 22:00:19 user nova-compute[72929]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 22:00:19 user nova-compute[72929]:     <boot dev='hd'/>
Aug 26 22:00:19 user nova-compute[72929]:     <smbios mode='sysinfo'/>
Aug 26 22:00:19 user nova-compute[72929]:   </os>
Aug 26 22:00:19 user nova-compute[72929]:   <features>
Aug 26 22:00:19 user nova-compute[72929]:     <acpi/>
Aug 26 22:00:19 user nova-compute[72929]:     <apic/>
Aug 26 22:00:19 user nova-compute[72929]:     <vmcoreinfo state='on'/>
Aug 26 22:00:19 user nova-compute[72929]:   </features>
Aug 26 22:00:19 user nova-compute[72929]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 22:00:19 user nova-compute[72929]:     <model fallback='forbid'>Nehalem</model>
Aug 26 22:00:19 user nova-compute[72929]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 22:00:19 user nova-compute[72929]:     <feature policy='require' name='vme'/>
Aug 26 22:00:19 user nova-compute[72929]:     <feature policy='require' name='x2apic'/>
Aug 26 22:00:19 user nova-compute[72929]:     <feature policy='require' name='hypervisor'/>
Aug 26 22:00:19 user nova-compute[72929]:   </cpu>
Aug 26 22:00:19 user nova-compute[72929]:   <clock offset='utc'>
Aug 26 22:00:19 user nova-compute[72929]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 22:00:19 user nova-compute[72929]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 22:00:19 user nova-compute[72929]:     <timer name='hpet' present='no'/>
Aug 26 22:00:19 user nova-compute[72929]:   </clock>
Aug 26 22:00:19 user nova-compute[72929]:   <on_poweroff>destroy</on_poweroff>
Aug 26 22:00:19 user nova-compute[72929]:   <on_reboot>restart</on_reboot>
Aug 26 22:00:19 user nova-compute[72929]:   <on_crash>destroy</on_crash>
Aug 26 22:00:19 user nova-compute[72929]:   <devices>
Aug 26 22:00:19 user nova-compute[72929]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 22:00:19 user nova-compute[72929]:     <disk type='file' device='disk'>
Aug 26 22:00:19 user nova-compute[72929]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 22:00:19 user nova-compute[72929]:       <source file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk' index='2'/>
Aug 26 22:00:19 user nova-compute[72929]:       <backingStore type='file' index='3'>
Aug 26 22:00:19 user nova-compute[72929]:         <format type='raw'/>
Aug 26 22:00:19 user nova-compute[72929]:         <source file='/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051'/>
Aug 26 22:00:19 user nova-compute[72929]:         <backingStore/>
Aug 26 22:00:19 user nova-compute[72929]:       </backingStore>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='vda' bus='virtio'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='virtio-disk0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </disk>
Aug 26 22:00:19 user nova-compute[72929]:     <disk type='file' device='cdrom'>
Aug 26 22:00:19 user nova-compute[72929]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 22:00:19 user nova-compute[72929]:       <source file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.config' index='1'/>
Aug 26 22:00:19 user nova-compute[72929]:       <backingStore/>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='hda' bus='ide'/>
Aug 26 22:00:19 user nova-compute[72929]:       <readonly/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='ide0-0-0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </disk>
Aug 26 22:00:19 user nova-compute[72929]:     <controller type='usb' index='0' model='none'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='usb'/>
Aug 26 22:00:19 user nova-compute[72929]:     </controller>
Aug 26 22:00:19 user nova-compute[72929]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='pci.0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </controller>
Aug 26 22:00:19 user nova-compute[72929]:     <controller type='ide' index='0'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='ide'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 22:00:19 user nova-compute[72929]:     </controller>
Aug 26 22:00:19 user nova-compute[72929]:     <interface type='ethernet'>
Aug 26 22:00:19 user nova-compute[72929]:       <mac address='fa:16:3e:b6:39:dd'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='tap2079e4a3-b5'/>
Aug 26 22:00:19 user nova-compute[72929]:       <model type='virtio'/>
Aug 26 22:00:19 user nova-compute[72929]:       <mtu size='1442'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='net0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </interface>
Aug 26 22:00:19 user nova-compute[72929]:     <interface type='ethernet'>
Aug 26 22:00:19 user nova-compute[72929]:       <mac address='fa:16:3e:e5:89:0c'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='tapdb9db397-bc'/>
Aug 26 22:00:19 user nova-compute[72929]:       <model type='virtio'/>
Aug 26 22:00:19 user nova-compute[72929]:       <mtu size='1442'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='net1'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </interface>
Aug 26 22:00:19 user nova-compute[72929]:     <serial type='pty'>
Aug 26 22:00:19 user nova-compute[72929]:       <source path='/dev/pts/7'/>
Aug 26 22:00:19 user nova-compute[72929]:       <log file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/console.log' append='off'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target type='isa-serial' port='0'>
Aug 26 22:00:19 user nova-compute[72929]:         <model name='isa-serial'/>
Aug 26 22:00:19 user nova-compute[72929]:       </target>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='serial0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </serial>
Aug 26 22:00:19 user nova-compute[72929]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 22:00:19 user nova-compute[72929]:       <source path='/dev/pts/7'/>
Aug 26 22:00:19 user nova-compute[72929]:       <log file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/console.log' append='off'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target type='serial' port='0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='serial0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </console>
Aug 26 22:00:19 user nova-compute[72929]:     <input type='mouse' bus='ps2'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='input0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </input>
Aug 26 22:00:19 user nova-compute[72929]:     <input type='keyboard' bus='ps2'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='input1'/>
Aug 26 22:00:19 user nova-compute[72929]:     </input>
Aug 26 22:00:19 user nova-compute[72929]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 22:00:19 user nova-compute[72929]:       <listen type='address' address='0.0.0.0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </graphics>
Aug 26 22:00:19 user nova-compute[72929]:     <audio id='1' type='none'/>
Aug 26 22:00:19 user nova-compute[72929]:     <video>
Aug 26 22:00:19 user nova-compute[72929]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='video0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </video>
Aug 26 22:00:19 user nova-compute[72929]:     <memballoon model='virtio'>
Aug 26 22:00:19 user nova-compute[72929]:       <stats period='10'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='balloon0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </memballoon>
Aug 26 22:00:19 user nova-compute[72929]:     <rng model='virtio'>
Aug 26 22:00:19 user nova-compute[72929]:       <backend model='random'>/dev/urandom</backend>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='rng0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </rng>
Aug 26 22:00:19 user nova-compute[72929]:   </devices>
Aug 26 22:00:19 user nova-compute[72929]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 22:00:19 user nova-compute[72929]:     <label>libvirt-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</label>
Aug 26 22:00:19 user nova-compute[72929]:     <imagelabel>libvirt-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</imagelabel>
Aug 26 22:00:19 user nova-compute[72929]:   </seclabel>
Aug 26 22:00:19 user nova-compute[72929]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 22:00:19 user nova-compute[72929]:     <label>+64055:+108</label>
Aug 26 22:00:19 user nova-compute[72929]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 22:00:19 user nova-compute[72929]:   </seclabel>
Aug 26 22:00:19 user nova-compute[72929]: </domain>
Aug 26 22:00:19 user nova-compute[72929]:  {{(pid=72929) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 22:00:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully detached device tapdb9db397-bc from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the persistent domain config.
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] (1/8): Attempting to detach device tapdb9db397-bc with device alias net1 from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] detach device xml: <interface type="ethernet">
Aug 26 22:00:19 user nova-compute[72929]:   <mac address="fa:16:3e:e5:89:0c"/>
Aug 26 22:00:19 user nova-compute[72929]:   <model type="virtio"/>
Aug 26 22:00:19 user nova-compute[72929]:   <mtu size="1442"/>
Aug 26 22:00:19 user nova-compute[72929]:   <target dev="tapdb9db397-bc"/>
Aug 26 22:00:19 user nova-compute[72929]: </interface>
Aug 26 22:00:19 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] No BDM found with device name hda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] No VIF found with MAC fa:16:3e:c6:30:45, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] No VIF found with MAC fa:16:3e:08:0e:57, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Using config drive
Aug 26 22:00:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Creating config drive at /opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8/disk.config
Aug 26 22:00:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi0fwatre {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087219.7348182, f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Start waiting for the detach event from libvirt for device tapdb9db397-bc with device alias net1 for instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:e5:89:0c"/><model type="virtio"/><mtu size="1442"/><target dev="tapdb9db397-bc"/></interface> {{(pid=72929) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:e5:89:0c"/><model type="virtio"/><mtu size="1442"/><target dev="tapdb9db397-bc"/></interface>not found in domain: <domain type='kvm' id='8'>
Aug 26 22:00:19 user nova-compute[72929]:   <name>instance-00000008</name>
Aug 26 22:00:19 user nova-compute[72929]:   <uuid>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</uuid>
Aug 26 22:00:19 user nova-compute[72929]:   <metadata>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:00:19 user nova-compute[72929]:   <nova:package version="0.0.0"/>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:name>tempest-device-tagging-server-1426573410</nova:name>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:creationTime>2023-08-26 21:59:56</nova:creationTime>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:flavor name="m1.tiny">
Aug 26 22:00:19 user nova-compute[72929]:     <nova:memory>512</nova:memory>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:disk>1</nova:disk>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:swap>0</nova:swap>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:vcpus>1</nova:vcpus>
Aug 26 22:00:19 user nova-compute[72929]:   </nova:flavor>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:owner>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:user uuid="b9347c20c29943a0ada7fbf255609767">tempest-TaggedAttachmentsTest-1623013215-project-member</nova:user>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:project uuid="459f54f128ef4e719c81a1eb92eb817d">tempest-TaggedAttachmentsTest-1623013215</nova:project>
Aug 26 22:00:19 user nova-compute[72929]:   </nova:owner>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:00:19 user nova-compute[72929]:   <nova:ports>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:port uuid="2079e4a3-b51b-49d9-a227-899cbd486ae5">
Aug 26 22:00:19 user nova-compute[72929]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 22:00:19 user nova-compute[72929]:     </nova:port>
Aug 26 22:00:19 user nova-compute[72929]:     <nova:port uuid="db9db397-bc88-41cb-8df1-b0bfcfc21b12">
Aug 26 22:00:19 user nova-compute[72929]:       <nova:ip type="fixed" address="10.10.10.8" ipVersion="4"/>
Aug 26 22:00:19 user nova-compute[72929]:     </nova:port>
Aug 26 22:00:19 user nova-compute[72929]:   </nova:ports>
Aug 26 22:00:19 user nova-compute[72929]: </nova:instance>
Aug 26 22:00:19 user nova-compute[72929]:   </metadata>
Aug 26 22:00:19 user nova-compute[72929]:   <memory unit='KiB'>524288</memory>
Aug 26 22:00:19 user nova-compute[72929]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 26 22:00:19 user nova-compute[72929]:   <vcpu placement='static'>1</vcpu>
Aug 26 22:00:19 user nova-compute[72929]:   <resource>
Aug 26 22:00:19 user nova-compute[72929]:     <partition>/machine</partition>
Aug 26 22:00:19 user nova-compute[72929]:   </resource>
Aug 26 22:00:19 user nova-compute[72929]:   <sysinfo type='smbios'>
Aug 26 22:00:19 user nova-compute[72929]:     <system>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='product'>OpenStack Nova</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='version'>0.0.0</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='serial'>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='uuid'>f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</entry>
Aug 26 22:00:19 user nova-compute[72929]:       <entry name='family'>Virtual Machine</entry>
Aug 26 22:00:19 user nova-compute[72929]:     </system>
Aug 26 22:00:19 user nova-compute[72929]:   </sysinfo>
Aug 26 22:00:19 user nova-compute[72929]:   <os>
Aug 26 22:00:19 user nova-compute[72929]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 26 22:00:19 user nova-compute[72929]:     <boot dev='hd'/>
Aug 26 22:00:19 user nova-compute[72929]:     <smbios mode='sysinfo'/>
Aug 26 22:00:19 user nova-compute[72929]:   </os>
Aug 26 22:00:19 user nova-compute[72929]:   <features>
Aug 26 22:00:19 user nova-compute[72929]:     <acpi/>
Aug 26 22:00:19 user nova-compute[72929]:     <apic/>
Aug 26 22:00:19 user nova-compute[72929]:     <vmcoreinfo state='on'/>
Aug 26 22:00:19 user nova-compute[72929]:   </features>
Aug 26 22:00:19 user nova-compute[72929]:   <cpu mode='custom' match='exact' check='full'>
Aug 26 22:00:19 user nova-compute[72929]:     <model fallback='forbid'>Nehalem</model>
Aug 26 22:00:19 user nova-compute[72929]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 26 22:00:19 user nova-compute[72929]:     <feature policy='require' name='vme'/>
Aug 26 22:00:19 user nova-compute[72929]:     <feature policy='require' name='x2apic'/>
Aug 26 22:00:19 user nova-compute[72929]:     <feature policy='require' name='hypervisor'/>
Aug 26 22:00:19 user nova-compute[72929]:   </cpu>
Aug 26 22:00:19 user nova-compute[72929]:   <clock offset='utc'>
Aug 26 22:00:19 user nova-compute[72929]:     <timer name='pit' tickpolicy='delay'/>
Aug 26 22:00:19 user nova-compute[72929]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 26 22:00:19 user nova-compute[72929]:     <timer name='hpet' present='no'/>
Aug 26 22:00:19 user nova-compute[72929]:   </clock>
Aug 26 22:00:19 user nova-compute[72929]:   <on_poweroff>destroy</on_poweroff>
Aug 26 22:00:19 user nova-compute[72929]:   <on_reboot>restart</on_reboot>
Aug 26 22:00:19 user nova-compute[72929]:   <on_crash>destroy</on_crash>
Aug 26 22:00:19 user nova-compute[72929]:   <devices>
Aug 26 22:00:19 user nova-compute[72929]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 26 22:00:19 user nova-compute[72929]:     <disk type='file' device='disk'>
Aug 26 22:00:19 user nova-compute[72929]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 26 22:00:19 user nova-compute[72929]:       <source file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk' index='2'/>
Aug 26 22:00:19 user nova-compute[72929]:       <backingStore type='file' index='3'>
Aug 26 22:00:19 user nova-compute[72929]:         <format type='raw'/>
Aug 26 22:00:19 user nova-compute[72929]:         <source file='/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051'/>
Aug 26 22:00:19 user nova-compute[72929]:         <backingStore/>
Aug 26 22:00:19 user nova-compute[72929]:       </backingStore>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='vda' bus='virtio'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='virtio-disk0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </disk>
Aug 26 22:00:19 user nova-compute[72929]:     <disk type='file' device='cdrom'>
Aug 26 22:00:19 user nova-compute[72929]:       <driver name='qemu' type='raw' cache='none'/>
Aug 26 22:00:19 user nova-compute[72929]:       <source file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/disk.config' index='1'/>
Aug 26 22:00:19 user nova-compute[72929]:       <backingStore/>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='hda' bus='ide'/>
Aug 26 22:00:19 user nova-compute[72929]:       <readonly/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='ide0-0-0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </disk>
Aug 26 22:00:19 user nova-compute[72929]:     <controller type='usb' index='0' model='none'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='usb'/>
Aug 26 22:00:19 user nova-compute[72929]:     </controller>
Aug 26 22:00:19 user nova-compute[72929]:     <controller type='pci' index='0' model='pci-root'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='pci.0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </controller>
Aug 26 22:00:19 user nova-compute[72929]:     <controller type='ide' index='0'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='ide'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 26 22:00:19 user nova-compute[72929]:     </controller>
Aug 26 22:00:19 user nova-compute[72929]:     <interface type='ethernet'>
Aug 26 22:00:19 user nova-compute[72929]:       <mac address='fa:16:3e:b6:39:dd'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target dev='tap2079e4a3-b5'/>
Aug 26 22:00:19 user nova-compute[72929]:       <model type='virtio'/>
Aug 26 22:00:19 user nova-compute[72929]:       <mtu size='1442'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='net0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </interface>
Aug 26 22:00:19 user nova-compute[72929]:     <serial type='pty'>
Aug 26 22:00:19 user nova-compute[72929]:       <source path='/dev/pts/7'/>
Aug 26 22:00:19 user nova-compute[72929]:       <log file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/console.log' append='off'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target type='isa-serial' port='0'>
Aug 26 22:00:19 user nova-compute[72929]:         <model name='isa-serial'/>
Aug 26 22:00:19 user nova-compute[72929]:       </target>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='serial0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </serial>
Aug 26 22:00:19 user nova-compute[72929]:     <console type='pty' tty='/dev/pts/7'>
Aug 26 22:00:19 user nova-compute[72929]:       <source path='/dev/pts/7'/>
Aug 26 22:00:19 user nova-compute[72929]:       <log file='/opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22/console.log' append='off'/>
Aug 26 22:00:19 user nova-compute[72929]:       <target type='serial' port='0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='serial0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </console>
Aug 26 22:00:19 user nova-compute[72929]:     <input type='mouse' bus='ps2'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='input0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </input>
Aug 26 22:00:19 user nova-compute[72929]:     <input type='keyboard' bus='ps2'>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='input1'/>
Aug 26 22:00:19 user nova-compute[72929]:     </input>
Aug 26 22:00:19 user nova-compute[72929]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Aug 26 22:00:19 user nova-compute[72929]:       <listen type='address' address='0.0.0.0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </graphics>
Aug 26 22:00:19 user nova-compute[72929]:     <audio id='1' type='none'/>
Aug 26 22:00:19 user nova-compute[72929]:     <video>
Aug 26 22:00:19 user nova-compute[72929]:       <model type='virtio' heads='1' primary='yes'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='video0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </video>
Aug 26 22:00:19 user nova-compute[72929]:     <memballoon model='virtio'>
Aug 26 22:00:19 user nova-compute[72929]:       <stats period='10'/>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='balloon0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </memballoon>
Aug 26 22:00:19 user nova-compute[72929]:     <rng model='virtio'>
Aug 26 22:00:19 user nova-compute[72929]:       <backend model='random'>/dev/urandom</backend>
Aug 26 22:00:19 user nova-compute[72929]:       <alias name='rng0'/>
Aug 26 22:00:19 user nova-compute[72929]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 26 22:00:19 user nova-compute[72929]:     </rng>
Aug 26 22:00:19 user nova-compute[72929]:   </devices>
Aug 26 22:00:19 user nova-compute[72929]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 26 22:00:19 user nova-compute[72929]:     <label>libvirt-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</label>
Aug 26 22:00:19 user nova-compute[72929]:     <imagelabel>libvirt-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22</imagelabel>
Aug 26 22:00:19 user nova-compute[72929]:   </seclabel>
Aug 26 22:00:19 user nova-compute[72929]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 26 22:00:19 user nova-compute[72929]:     <label>+64055:+108</label>
Aug 26 22:00:19 user nova-compute[72929]:     <imagelabel>+64055:+108</imagelabel>
Aug 26 22:00:19 user nova-compute[72929]:   </seclabel>
Aug 26 22:00:19 user nova-compute[72929]: </domain>
Aug 26 22:00:19 user nova-compute[72929]:  {{(pid=72929) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 26 22:00:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully detached device tapdb9db397-bc from instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 from the live domain config.
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "address": "fa:16:3e:e5:89:0c", "network": {"id": "52f78936-f37e-4a68-9c7e-92fdc9513dac", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-707455694", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb9db397-bc", "ovs_interfaceid": "db9db397-bc88-41cb-8df1-b0bfcfc21b12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG os_vif [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpi0fwatre" returned: 0 in 0.078s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb9db397-bc, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:20 user nova-compute[72929]: INFO os_vif [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:89:0c,bridge_name='br-int',has_traffic_filtering=True,id=db9db397-bc88-41cb-8df1-b0bfcfc21b12,network=Network(52f78936-f37e-4a68-9c7e-92fdc9513dac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb9db397-bc')
Aug 26 22:00:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:00:20 user nova-compute[72929]:   <nova:package version="0.0.0"/>
Aug 26 22:00:20 user nova-compute[72929]:   <nova:name>tempest-device-tagging-server-1426573410</nova:name>
Aug 26 22:00:20 user nova-compute[72929]:   <nova:creationTime>2023-08-26 22:00:20</nova:creationTime>
Aug 26 22:00:20 user nova-compute[72929]:   <nova:flavor name="m1.tiny">
Aug 26 22:00:20 user nova-compute[72929]:     <nova:memory>512</nova:memory>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:disk>1</nova:disk>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:swap>0</nova:swap>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:vcpus>1</nova:vcpus>
Aug 26 22:00:20 user nova-compute[72929]:   </nova:flavor>
Aug 26 22:00:20 user nova-compute[72929]:   <nova:owner>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:user uuid="b9347c20c29943a0ada7fbf255609767">tempest-TaggedAttachmentsTest-1623013215-project-member</nova:user>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:project uuid="459f54f128ef4e719c81a1eb92eb817d">tempest-TaggedAttachmentsTest-1623013215</nova:project>
Aug 26 22:00:20 user nova-compute[72929]:   </nova:owner>
Aug 26 22:00:20 user nova-compute[72929]:   <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:00:20 user nova-compute[72929]:   <nova:ports>
Aug 26 22:00:20 user nova-compute[72929]:     <nova:port uuid="2079e4a3-b51b-49d9-a227-899cbd486ae5">
Aug 26 22:00:20 user nova-compute[72929]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 22:00:20 user nova-compute[72929]:     </nova:port>
Aug 26 22:00:20 user nova-compute[72929]:   </nova:ports>
Aug 26 22:00:20 user nova-compute[72929]: </nova:instance>
Aug 26 22:00:20 user nova-compute[72929]:  {{(pid=72929) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-2a35368c-2473-4d63-9d86-c4a2a35890af req-296ef01d-7336-4832-a363-0160c9026df1 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-unplugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2a35368c-2473-4d63-9d86-c4a2a35890af req-296ef01d-7336-4832-a363-0160c9026df1 service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2a35368c-2473-4d63-9d86-c4a2a35890af req-296ef01d-7336-4832-a363-0160c9026df1 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2a35368c-2473-4d63-9d86-c4a2a35890af req-296ef01d-7336-4832-a363-0160c9026df1 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-2a35368c-2473-4d63-9d86-c4a2a35890af req-296ef01d-7336-4832-a363-0160c9026df1 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-unplugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:20 user nova-compute[72929]: WARNING nova.compute.manager [req-2a35368c-2473-4d63-9d86-c4a2a35890af req-296ef01d-7336-4832-a363-0160c9026df1 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-unplugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 for instance with vm_state active and task_state None.
Aug 26 22:00:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquired lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:20 user nova-compute[72929]: DEBUG nova.network.neutron [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:00:21 user nova-compute[72929]: INFO nova.network.neutron [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Port db9db397-bc88-41cb-8df1-b0bfcfc21b12 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 26 22:00:21 user nova-compute[72929]: DEBUG nova.network.neutron [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [{"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Releasing lock "refresh_cache-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-eb428ee5-12b9-4ffb-b81d-f29bd1f63f61 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "interface-f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-db9db397-bc88-41cb-8df1-b0bfcfc21b12" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.204s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-c217a66f-9067-4043-872b-b31d7763edcb req-9eaf4d20-9474-4254-a10d-387477f6fb2b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c217a66f-9067-4043-872b-b31d7763edcb req-9eaf4d20-9474-4254-a10d-387477f6fb2b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c217a66f-9067-4043-872b-b31d7763edcb req-9eaf4d20-9474-4254-a10d-387477f6fb2b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c217a66f-9067-4043-872b-b31d7763edcb req-9eaf4d20-9474-4254-a10d-387477f6fb2b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-c217a66f-9067-4043-872b-b31d7763edcb req-9eaf4d20-9474-4254-a10d-387477f6fb2b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:22 user nova-compute[72929]: WARNING nova.compute.manager [req-c217a66f-9067-4043-872b-b31d7763edcb req-9eaf4d20-9474-4254-a10d-387477f6fb2b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 for instance with vm_state building and task_state spawning.
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:22 user nova-compute[72929]: WARNING nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-plugged-db9db397-bc88-41cb-8df1-b0bfcfc21b12 for instance with vm_state active and task_state None.
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-deleted-db9db397-bc88-41cb-8df1-b0bfcfc21b12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:22 user nova-compute[72929]: WARNING nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade for instance with vm_state building and task_state spawning.
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:22 user nova-compute[72929]: WARNING nova.compute.manager [req-9e83b994-4db8-401c-85a1-9333a9bc5118 req-17af60ff-60d1-440e-b91c-167491aae591 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade for instance with vm_state building and task_state spawning.
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-2dc6bd86-bab3-45c8-be44-fa91c5898f98 req-de961314-a238-4724-ac27-815697722579 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2dc6bd86-bab3-45c8-be44-fa91c5898f98 req-de961314-a238-4724-ac27-815697722579 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2dc6bd86-bab3-45c8-be44-fa91c5898f98 req-de961314-a238-4724-ac27-815697722579 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2dc6bd86-bab3-45c8-be44-fa91c5898f98 req-de961314-a238-4724-ac27-815697722579 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-2dc6bd86-bab3-45c8-be44-fa91c5898f98 req-de961314-a238-4724-ac27-815697722579 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:22 user nova-compute[72929]: WARNING nova.compute.manager [req-2dc6bd86-bab3-45c8-be44-fa91c5898f98 req-de961314-a238-4724-ac27-815697722579 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 for instance with vm_state building and task_state spawning.
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-164e5a39-945f-47a4-bc54-ef4056dafc0b req-ceaee767-fd14-42a8-b4d8-52a64c99de03 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-72fd5577-fe45-41cb-9319-013ea1c6944e req-4479dcc2-454a-4799-ac6c-974f2ba3d42b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-72fd5577-fe45-41cb-9319-013ea1c6944e req-4479dcc2-454a-4799-ac6c-974f2ba3d42b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-72fd5577-fe45-41cb-9319-013ea1c6944e req-4479dcc2-454a-4799-ac6c-974f2ba3d42b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-72fd5577-fe45-41cb-9319-013ea1c6944e req-4479dcc2-454a-4799-ac6c-974f2ba3d42b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-72fd5577-fe45-41cb-9319-013ea1c6944e req-4479dcc2-454a-4799-ac6c-974f2ba3d42b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-72fd5577-fe45-41cb-9319-013ea1c6944e req-4479dcc2-454a-4799-ac6c-974f2ba3d42b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:24 user nova-compute[72929]: WARNING nova.compute.manager [req-0e61e00d-03b7-4fa6-901e-84fc375dfe0b req-24ebfc75-9594-41f3-b86a-349d6b22b79c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 for instance with vm_state building and task_state spawning.
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087226.2156181, 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] VM Resumed (Lifecycle Event)
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance spawned successfully.
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087226.2221525, 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] VM Started (Lifecycle Event)
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-84301df6-7a5a-4b30-8d8b-542e3de0958f req-e4053a11-5ebb-49d4-b423-92e5d82d4273 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84301df6-7a5a-4b30-8d8b-542e3de0958f req-e4053a11-5ebb-49d4-b423-92e5d82d4273 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84301df6-7a5a-4b30-8d8b-542e3de0958f req-e4053a11-5ebb-49d4-b423-92e5d82d4273 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84301df6-7a5a-4b30-8d8b-542e3de0958f req-e4053a11-5ebb-49d4-b423-92e5d82d4273 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-84301df6-7a5a-4b30-8d8b-542e3de0958f req-e4053a11-5ebb-49d4-b423-92e5d82d4273 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:26 user nova-compute[72929]: WARNING nova.compute.manager [req-84301df6-7a5a-4b30-8d8b-542e3de0958f req-e4053a11-5ebb-49d4-b423-92e5d82d4273 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 for instance with vm_state building and task_state spawning.
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Took 14.66 seconds to spawn the instance on the hypervisor.
Aug 26 22:00:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:26 user nova-compute[72929]: INFO nova.compute.manager [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Took 93.06 seconds to build instance.
Aug 26 22:00:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c816d2e-b93c-415c-b879-50a9c30281c0 tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 93.167s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lazy-loading 'flavor' on Instance uuid 86b0db90-8909-4572-8d40-888dc5151698 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3aedafe2-0a57-46ce-bb0a-1ad3bc74a6b8 tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 15.064s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBRxLYkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:27 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:27 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:27 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed17f04-4a2c-4d5b-b914-f11078d8a2ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:00:27 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[da26f14f-487f-493a-81c4-15db6b394262]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f] added
Aug 26 22:00:27 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b2e2b-4881-41f2-93eb-00bcff160ab4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a2aa0-6b99-420c-8a0c-b5f5ef8f416c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBRxLYkg {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DBRxLYkg" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[89063f81-52ce-4fef-b432-978e98566de6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DBRxLYkg'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bcd71-57b3-4e40-82e1-c4cfa807ddbb]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16ddf81-5483-418c-94ae-4e3b80ce0e6a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac58fe3-1030-425f-9961-ca4ce5df165f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260]
Aug 26 22:00:27 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:27 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e63a6d-cd46-4a47-96b0-e3dca6515892]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53d86f1-1c7b-4cef-a78b-90cf8209cbf5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:27 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb68912-70cb-47db-8816-f6c4ebc1616a]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:00:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBRxLYkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:28 user nova-compute[72929]: INFO nova.compute.manager [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Terminating instance
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-b63d4309-b8fa-4ff0-b6c2-38c6b2bf37de req-35edb40e-9312-4406-8a44-26ba3be481fd service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-vif-unplugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b63d4309-b8fa-4ff0-b6c2-38c6b2bf37de req-35edb40e-9312-4406-8a44-26ba3be481fd service nova] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b63d4309-b8fa-4ff0-b6c2-38c6b2bf37de req-35edb40e-9312-4406-8a44-26ba3be481fd service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b63d4309-b8fa-4ff0-b6c2-38c6b2bf37de req-35edb40e-9312-4406-8a44-26ba3be481fd service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-b63d4309-b8fa-4ff0-b6c2-38c6b2bf37de req-35edb40e-9312-4406-8a44-26ba3be481fd service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] No waiting events found dispatching network-vif-unplugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-b63d4309-b8fa-4ff0-b6c2-38c6b2bf37de req-35edb40e-9312-4406-8a44-26ba3be481fd service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-vif-unplugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23132353433343361', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132353433343361', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lazy-loading 'flavor' on Instance uuid 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] attach device xml: <disk type="block" device="disk">
Aug 26 22:00:28 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:28 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:00:28 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:00:28 user nova-compute[72929]:   <serial>71db5fb4-7c40-4612-be5c-12b7e3d0a55f</serial>
Aug 26 22:00:28 user nova-compute[72929]: </disk>
Aug 26 22:00:28 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087214.0099223, 8555f690-3843-4989-8d93-2bf3ce87e8ef => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:29 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] VM Stopped (Lifecycle Event)
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1c5476ab-1e43-4f0b-9059-22dcdb4cd166 None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Instance destroyed successfully.
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lazy-loading 'resources' on Instance uuid 86b0db90-8909-4572-8d40-888dc5151698 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1427551150',display_name='tempest-AttachSCSIVolumeTestJSON-server-1427551150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1427551150',id=7,image_ref='fdb76caf-b4f8-48f8-894b-47c48ce1d283',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA76fuw1Tv4CpC5Vae2C1A706pk+egpTpfxGHdvQnGFrsSfUvvjwY4W7A1mtznGi3d8bKKET2cpLtWGxAzS18gSq4cM3m2LlSeSx6B1UKq0MP9Xt6UtNzmkwcpoIUy32PQ==',key_name='tempest-keypair-1818727377',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0859e779cef94ade81b7cab93675a248',ramdisk_id='',reservation_id='r-mt84eqoj',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fdb76caf-b4f8-48f8-894b-47c48ce1d283',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-556521636',owner_user_name='tempest-AttachSCSIVolumeTestJSON-556521636-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='656e0f45e77346aca4eae789ee358e59',uuid=86b0db90-8909-4572-8d40-888dc5151698,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Converting VIF {"id": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "address": "fa:16:3e:0d:9d:ae", "network": {"id": "22b291a6-f855-4255-b1bb-6b8fc4d6d428", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1968328400-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0859e779cef94ade81b7cab93675a248", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda9d466b-10", "ovs_interfaceid": "da9d466b-10f9-415a-b4d5-85a26b55fd98", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG os_vif [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda9d466b-10, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:29 user nova-compute[72929]: INFO os_vif [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:9d:ae,bridge_name='br-int',has_traffic_filtering=True,id=da9d466b-10f9-415a-b4d5-85a26b55fd98,network=Network(22b291a6-f855-4255-b1bb-6b8fc4d6d428),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda9d466b-10')
Aug 26 22:00:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Deleting instance files /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698_del
Aug 26 22:00:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Deletion of /opt/stack/data/nova/instances/86b0db90-8909-4572-8d40-888dc5151698_del complete
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] No VIF found with MAC fa:16:3e:13:a1:f6, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:29 user nova-compute[72929]: INFO nova.compute.manager [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 22:00:29 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:00:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3e8d1ea1-6428-4625-a323-436f918ff33f tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.735s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] volume_snapshot_create: create_info: {'snapshot_id': '3d8f37ac-5534-43a2-b262-f3c46c95bd91', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72929) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] snap xml: <domainsnapshot>
Aug 26 22:00:30 user nova-compute[72929]:   <disks>
Aug 26 22:00:30 user nova-compute[72929]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 26 22:00:30 user nova-compute[72929]:       <source file="/dev/new_file"/>
Aug 26 22:00:30 user nova-compute[72929]:     </disk>
Aug 26 22:00:30 user nova-compute[72929]:     <disk name="vda" snapshot="no"/>
Aug 26 22:00:30 user nova-compute[72929]:   </disks>
Aug 26 22:00:30 user nova-compute[72929]: </domainsnapshot>
Aug 26 22:00:30 user nova-compute[72929]:  {{(pid=72929) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] Lazy-loading 'system_metadata' on Instance uuid 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-13e70a16-3fd8-4fc8-a5c6-1286bd5d6d37 req-d719199c-dd69-4666-b349-4fc527980f93 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13e70a16-3fd8-4fc8-a5c6-1286bd5d6d37 req-d719199c-dd69-4666-b349-4fc527980f93 service nova] Acquiring lock "86b0db90-8909-4572-8d40-888dc5151698-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13e70a16-3fd8-4fc8-a5c6-1286bd5d6d37 req-d719199c-dd69-4666-b349-4fc527980f93 service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13e70a16-3fd8-4fc8-a5c6-1286bd5d6d37 req-d719199c-dd69-4666-b349-4fc527980f93 service nova] Lock "86b0db90-8909-4572-8d40-888dc5151698-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-13e70a16-3fd8-4fc8-a5c6-1286bd5d6d37 req-d719199c-dd69-4666-b349-4fc527980f93 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] No waiting events found dispatching network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:30 user nova-compute[72929]: WARNING nova.compute.manager [req-13e70a16-3fd8-4fc8-a5c6-1286bd5d6d37 req-d719199c-dd69-4666-b349-4fc527980f93 service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received unexpected event network-vif-plugged-da9d466b-10f9-415a-b4d5-85a26b55fd98 for instance with vm_state active and task_state deleting.
Aug 26 22:00:30 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     rv = execute(f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     six.reraise(c, e, tb)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     raise value
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     rv = meth(*args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     self._volume_snapshot_create(context, instance, guest,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     rv = execute(f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     six.reraise(c, e, tb)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     raise value
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     rv = meth(*args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] 
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-62c3c045-35c0-4fa3-8d84-7e342e377c6f tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] volume_snapshot_delete: delete_info: {'volume_id': '71db5fb4-7c40-4612-be5c-12b7e3d0a55f'} {{(pid=72929) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [None req-62c3c045-35c0-4fa3-8d84-7e342e377c6f tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6]     if delete_info['type'] != 'qcow2':
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] KeyError: 'type'
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3d8f37ac-5534-43a2-b262-f3c46c95bd91 could not be found.
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise value
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3d8f37ac-5534-43a2-b262-f3c46c95bd91 could not be found. (HTTP 404) (Request-ID: req-c96bae0d-3906-4044-92b4-18e1418fde2e)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3d8f37ac-5534-43a2-b262-f3c46c95bd91 could not be found.
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver [None req-62c3c045-35c0-4fa3-8d84-7e342e377c6f tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-69b56de0-0bac-4bc0-a2ca-67fb0a515cdc)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 26 22:00:30 user nova-compute[72929]: ERROR nova.virt.libvirt.driver 
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server [None req-c918a7b1-5673-46f6-9913-2690155e65ca tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise value
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server 
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server [None req-62c3c045-35c0-4fa3-8d84-7e342e377c6f tempest-VolumesAssistedSnapshotsTest-1421476254 tempest-VolumesAssistedSnapshotsTest-1421476254-project] Exception during message handling: KeyError: 'type'
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 26 22:00:30 user nova-compute[72929]: ERROR oslo_messaging.rpc.server 
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-00da287c-f541-4112-ad94-d1c3396ccd4c req-c90528fc-e6eb-48fb-85ce-675245f80b6c service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Received event network-vif-deleted-da9d466b-10f9-415a-b4d5-85a26b55fd98 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:30 user nova-compute[72929]: INFO nova.compute.manager [req-00da287c-f541-4112-ad94-d1c3396ccd4c req-c90528fc-e6eb-48fb-85ce-675245f80b6c service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Neutron deleted interface da9d466b-10f9-415a-b4d5-85a26b55fd98; detaching it from the instance and deleting it from the info cache
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.network.neutron [req-00da287c-f541-4112-ad94-d1c3396ccd4c req-c90528fc-e6eb-48fb-85ce-675245f80b6c service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:30 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Took 1.52 seconds to deallocate network for instance.
Aug 26 22:00:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-00da287c-f541-4112-ad94-d1c3396ccd4c req-c90528fc-e6eb-48fb-85ce-675245f80b6c service nova] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Detach interface failed, port_id=da9d466b-10f9-415a-b4d5-85a26b55fd98, reason: Instance 86b0db90-8909-4572-8d40-888dc5151698 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:31 user nova-compute[72929]: INFO nova.compute.manager [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Detaching volume 71db5fb4-7c40-4612-be5c-12b7e3d0a55f
Aug 26 22:00:31 user nova-compute[72929]: INFO nova.virt.block_device [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Attempting to driver detach volume 71db5fb4-7c40-4612-be5c-12b7e3d0a55f from mountpoint /dev/vdb
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Attempting to detach device vdb from instance 67091d20-1923-4efb-92eb-f11df34f85e6 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 22:00:31 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:31 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:00:31 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:00:31 user nova-compute[72929]:   <serial>71db5fb4-7c40-4612-be5c-12b7e3d0a55f</serial>
Aug 26 22:00:31 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:00:31 user nova-compute[72929]: </disk>
Aug 26 22:00:31 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Successfully detached device vdb from instance 67091d20-1923-4efb-92eb-f11df34f85e6 from the persistent domain config.
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67091d20-1923-4efb-92eb-f11df34f85e6 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] detach device xml: <disk type="block" device="disk">
Aug 26 22:00:31 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:00:31 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:00:31 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:00:31 user nova-compute[72929]:   <serial>71db5fb4-7c40-4612-be5c-12b7e3d0a55f</serial>
Aug 26 22:00:31 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:00:31 user nova-compute[72929]: </disk>
Aug 26 22:00:31 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:31 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Deleted allocations for instance 86b0db90-8909-4572-8d40-888dc5151698
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ddc8d4dd-5949-4852-b95c-9e0db21a2cbe tempest-AttachSCSIVolumeTestJSON-556521636 tempest-AttachSCSIVolumeTestJSON-556521636-project-member] Lock "86b0db90-8909-4572-8d40-888dc5151698" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.316s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087231.5735013, 67091d20-1923-4efb-92eb-f11df34f85e6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:00:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Successfully detached device vdb from instance 67091d20-1923-4efb-92eb-f11df34f85e6 from the live domain config.
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DBRxLYkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:00:31 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffb22f3-7245-42e6-80de-1ad3c842010f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd515863-334d-4387-acc2-a71c704419ab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:00:31 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:00:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba6897760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bc8c73-fcc5-409e-9e4d-db122296889d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b1beb0-b942-43ca-8a67-66d74e0ea89e]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[60707cc7-d75a-4ac2-8d7d-0edb4081a445]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[361d9054-63a8-464b-9bfd-a8467a4b12a2]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd81d0a5-1ede-4358-a2d9-147cf792d866]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e75700-935f-403a-8ba7-a5c0425ef23b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260]
Aug 26 22:00:31 user nova-compute[72929]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f, portal: 172.16.0.220,3260] successful.
Aug 26 22:00:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71db5fb4-7c40-4612-be5c-12b7e3d0a55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4057bc56-cf35-4e03-9780-2207f419f485]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] <== disconnect_volume: return (317ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:00:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:00:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lazy-loading 'flavor' on Instance uuid 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9943469c-89bb-4db7-b693-7854442fb3a8 tempest-VolumesAssistedSnapshotsTest-530865950 tempest-VolumesAssistedSnapshotsTest-530865950-project-admin] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.063s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:44 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087229.306392, 86b0db90-8909-4572-8d40-888dc5151698 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:44 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 86b0db90-8909-4572-8d40-888dc5151698] VM Stopped (Lifecycle Event)
Aug 26 22:00:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-24286038-4639-4f78-85c1-d55057c492ce None None] [instance: 86b0db90-8909-4572-8d40-888dc5151698] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:00:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:00:47 user nova-compute[72929]: INFO nova.compute.claims [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Claim successful on node user
Aug 26 22:00:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:00:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:00:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Creating image(s)
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "/opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "/opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.policy [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6509530943dc49dc897e975e0695292f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1296783b514e0a93a7d6b8d464335c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk 1073741824" returned: 0 in 0.049s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:00:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Cannot resize image /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Ensure instance console log exists: /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG nova.network.neutron [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Successfully created port: b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:00:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.network.neutron [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Successfully updated port: b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "refresh_cache-c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquired lock "refresh_cache-c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.network.neutron [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-changed-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Refreshing instance network info cache due to event network-changed-b830140f-6f6c-44f4-b654-5383a95d2f3c. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] Acquiring lock "refresh_cache-c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "c1608933-05ed-4314-a13b-a48035aa841b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:00:50 user nova-compute[72929]: INFO nova.compute.claims [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Claim successful on node user
Aug 26 22:00:50 user nova-compute[72929]: DEBUG nova.network.neutron [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.neutron [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Updating instance_info_cache with network_info: [{"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Releasing lock "refresh_cache-c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Instance network_info: |[{"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] Acquired lock "refresh_cache-c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.neutron [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Refreshing network info cache for port b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Start _get_guest_xml network_info=[{"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:00:51 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:00:51 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:51 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-635105439',display_name='tempest-VolumesAdminNegativeTest-server-635105439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-635105439',id=13,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1296783b514e0a93a7d6b8d464335c',ramdisk_id='',reservation_id='r-9bfzec7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1477467048',owner_user_name='tempest-VolumesAdminNegativeTest-1477467048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:00:48Z,user_data=None,user_id='6509530943dc49dc897e975e0695292f',uuid=c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converting VIF {"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.objects.instance [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'pci_devices' on Instance uuid c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:00:51 user nova-compute[72929]:   <uuid>c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e</uuid>
Aug 26 22:00:51 user nova-compute[72929]:   <name>instance-0000000d</name>
Aug 26 22:00:51 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:00:51 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:00:51 user nova-compute[72929]:   <metadata>
Aug 26 22:00:51 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:00:51 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:00:51 user nova-compute[72929]:       <nova:name>tempest-VolumesAdminNegativeTest-server-635105439</nova:name>
Aug 26 22:00:51 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:00:51</nova:creationTime>
Aug 26 22:00:51 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:00:51 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:00:51 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:00:51 user nova-compute[72929]:       <nova:owner>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:user uuid="6509530943dc49dc897e975e0695292f">tempest-VolumesAdminNegativeTest-1477467048-project-member</nova:user>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:project uuid="9b1296783b514e0a93a7d6b8d464335c">tempest-VolumesAdminNegativeTest-1477467048</nova:project>
Aug 26 22:00:51 user nova-compute[72929]:       </nova:owner>
Aug 26 22:00:51 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:00:51 user nova-compute[72929]:       <nova:ports>
Aug 26 22:00:51 user nova-compute[72929]:         <nova:port uuid="b830140f-6f6c-44f4-b654-5383a95d2f3c">
Aug 26 22:00:51 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:00:51 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:51 user nova-compute[72929]:       </nova:ports>
Aug 26 22:00:51 user nova-compute[72929]:     </nova:instance>
Aug 26 22:00:51 user nova-compute[72929]:   </metadata>
Aug 26 22:00:51 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:00:51 user nova-compute[72929]:     <system>
Aug 26 22:00:51 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:00:51 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:00:51 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:00:51 user nova-compute[72929]:       <entry name="serial">c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e</entry>
Aug 26 22:00:51 user nova-compute[72929]:       <entry name="uuid">c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e</entry>
Aug 26 22:00:51 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:00:51 user nova-compute[72929]:     </system>
Aug 26 22:00:51 user nova-compute[72929]:   </sysinfo>
Aug 26 22:00:51 user nova-compute[72929]:   <os>
Aug 26 22:00:51 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:00:51 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:00:51 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:00:51 user nova-compute[72929]:   </os>
Aug 26 22:00:51 user nova-compute[72929]:   <features>
Aug 26 22:00:51 user nova-compute[72929]:     <acpi/>
Aug 26 22:00:51 user nova-compute[72929]:     <apic/>
Aug 26 22:00:51 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:00:51 user nova-compute[72929]:   </features>
Aug 26 22:00:51 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:00:51 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:00:51 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:00:51 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:00:51 user nova-compute[72929]:   </clock>
Aug 26 22:00:51 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:00:51 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:00:51 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:00:51 user nova-compute[72929]:   </cpu>
Aug 26 22:00:51 user nova-compute[72929]:   <devices>
Aug 26 22:00:51 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:00:51 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:00:51 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk"/>
Aug 26 22:00:51 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:00:51 user nova-compute[72929]:     </disk>
Aug 26 22:00:51 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:51 user nova-compute[72929]:       <mac address="fa:16:3e:a3:75:77"/>
Aug 26 22:00:51 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:51 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:51 user nova-compute[72929]:       <target dev="tapb830140f-6f"/>
Aug 26 22:00:51 user nova-compute[72929]:     </interface>
Aug 26 22:00:51 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:00:51 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/console.log" append="off"/>
Aug 26 22:00:51 user nova-compute[72929]:     </serial>
Aug 26 22:00:51 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:00:51 user nova-compute[72929]:     <video>
Aug 26 22:00:51 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:51 user nova-compute[72929]:     </video>
Aug 26 22:00:51 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:00:51 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:00:51 user nova-compute[72929]:     </rng>
Aug 26 22:00:51 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:00:51 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:00:51 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:00:51 user nova-compute[72929]:     </memballoon>
Aug 26 22:00:51 user nova-compute[72929]:   </devices>
Aug 26 22:00:51 user nova-compute[72929]: </domain>
Aug 26 22:00:51 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-635105439',display_name='tempest-VolumesAdminNegativeTest-server-635105439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-635105439',id=13,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b1296783b514e0a93a7d6b8d464335c',ramdisk_id='',reservation_id='r-9bfzec7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1477467048',owner_user_name='tempest-VolumesAdminNegativeTest-1477467048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:00:48Z,user_data=None,user_id='6509530943dc49dc897e975e0695292f',uuid=c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converting VIF {"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG os_vif [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.policy [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93c597a2c99646f1bb79645380ce0b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6cde0e448142e48abb9220470391f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb830140f-6f, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb830140f-6f, col_values=(('external_ids', {'iface-id': 'b830140f-6f6c-44f4-b654-5383a95d2f3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:75:77', 'vm-uuid': 'c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:51 user nova-compute[72929]: INFO os_vif [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f')
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:00:51 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Creating image(s)
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "/opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "/opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] No VIF found with MAC fa:16:3e:a3:75:77, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.neutron [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Updated VIF entry in instance network info cache for port b830140f-6f6c-44f4-b654-5383a95d2f3c. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.neutron [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Updating instance_info_cache with network_info: [{"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk 1073741824" returned: 0 in 0.065s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1ddce396-d1a7-4c28-9eb6-48d80d477992 req-a4233b1b-09c0-4a9e-9106-52d44a29cb6b service nova] Releasing lock "refresh_cache-c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Successfully created port: 8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:00:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Cannot resize image /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Ensure instance console log exists: /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Successfully updated port: 8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-changed-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Refreshing instance network info cache due to event network-changed-8c43ee94-0853-4850-95f1-3f889602ec01. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-4efa3b3e-ab2b-4a13-9e1f-89af15bfed8b req-4b4ae222-384f-4332-ba6d-3bb394b87c0b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4efa3b3e-ab2b-4a13-9e1f-89af15bfed8b req-4b4ae222-384f-4332-ba6d-3bb394b87c0b service nova] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4efa3b3e-ab2b-4a13-9e1f-89af15bfed8b req-4b4ae222-384f-4332-ba6d-3bb394b87c0b service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4efa3b3e-ab2b-4a13-9e1f-89af15bfed8b req-4b4ae222-384f-4332-ba6d-3bb394b87c0b service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-4efa3b3e-ab2b-4a13-9e1f-89af15bfed8b req-4b4ae222-384f-4332-ba6d-3bb394b87c0b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] No waiting events found dispatching network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:52 user nova-compute[72929]: WARNING nova.compute.manager [req-4efa3b3e-ab2b-4a13-9e1f-89af15bfed8b req-4b4ae222-384f-4332-ba6d-3bb394b87c0b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received unexpected event network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c for instance with vm_state building and task_state spawning.
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Instance network_info: |[{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Refreshing network info cache for port 8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Start _get_guest_xml network_info=[{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:00:53 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:53 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1642304118',display_name='tempest-ServerActionsTestOtherA-server-1642304118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1642304118',id=14,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-1nlxy90r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=c1608933-05ed-4314-a13b-a48035aa841b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'pci_devices' on Instance uuid c1608933-05ed-4314-a13b-a48035aa841b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:00:53 user nova-compute[72929]:   <uuid>c1608933-05ed-4314-a13b-a48035aa841b</uuid>
Aug 26 22:00:53 user nova-compute[72929]:   <name>instance-0000000e</name>
Aug 26 22:00:53 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:00:53 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:00:53 user nova-compute[72929]:   <metadata>
Aug 26 22:00:53 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:00:53 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:00:53 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherA-server-1642304118</nova:name>
Aug 26 22:00:53 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:00:53</nova:creationTime>
Aug 26 22:00:53 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:00:53 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:00:53 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:00:53 user nova-compute[72929]:       <nova:owner>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:user uuid="93c597a2c99646f1bb79645380ce0b75">tempest-ServerActionsTestOtherA-1951554093-project-member</nova:user>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:project uuid="4e6cde0e448142e48abb9220470391f2">tempest-ServerActionsTestOtherA-1951554093</nova:project>
Aug 26 22:00:53 user nova-compute[72929]:       </nova:owner>
Aug 26 22:00:53 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:00:53 user nova-compute[72929]:       <nova:ports>
Aug 26 22:00:53 user nova-compute[72929]:         <nova:port uuid="8c43ee94-0853-4850-95f1-3f889602ec01">
Aug 26 22:00:53 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 22:00:53 user nova-compute[72929]:         </nova:port>
Aug 26 22:00:53 user nova-compute[72929]:       </nova:ports>
Aug 26 22:00:53 user nova-compute[72929]:     </nova:instance>
Aug 26 22:00:53 user nova-compute[72929]:   </metadata>
Aug 26 22:00:53 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:00:53 user nova-compute[72929]:     <system>
Aug 26 22:00:53 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:00:53 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:00:53 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:00:53 user nova-compute[72929]:       <entry name="serial">c1608933-05ed-4314-a13b-a48035aa841b</entry>
Aug 26 22:00:53 user nova-compute[72929]:       <entry name="uuid">c1608933-05ed-4314-a13b-a48035aa841b</entry>
Aug 26 22:00:53 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:00:53 user nova-compute[72929]:     </system>
Aug 26 22:00:53 user nova-compute[72929]:   </sysinfo>
Aug 26 22:00:53 user nova-compute[72929]:   <os>
Aug 26 22:00:53 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:00:53 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:00:53 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:00:53 user nova-compute[72929]:   </os>
Aug 26 22:00:53 user nova-compute[72929]:   <features>
Aug 26 22:00:53 user nova-compute[72929]:     <acpi/>
Aug 26 22:00:53 user nova-compute[72929]:     <apic/>
Aug 26 22:00:53 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:00:53 user nova-compute[72929]:   </features>
Aug 26 22:00:53 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:00:53 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:00:53 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:00:53 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:00:53 user nova-compute[72929]:   </clock>
Aug 26 22:00:53 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:00:53 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:00:53 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:00:53 user nova-compute[72929]:   </cpu>
Aug 26 22:00:53 user nova-compute[72929]:   <devices>
Aug 26 22:00:53 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:00:53 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:00:53 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk"/>
Aug 26 22:00:53 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:00:53 user nova-compute[72929]:     </disk>
Aug 26 22:00:53 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:00:53 user nova-compute[72929]:       <mac address="fa:16:3e:c6:4d:d3"/>
Aug 26 22:00:53 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:53 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:00:53 user nova-compute[72929]:       <target dev="tap8c43ee94-08"/>
Aug 26 22:00:53 user nova-compute[72929]:     </interface>
Aug 26 22:00:53 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:00:53 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/console.log" append="off"/>
Aug 26 22:00:53 user nova-compute[72929]:     </serial>
Aug 26 22:00:53 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:00:53 user nova-compute[72929]:     <video>
Aug 26 22:00:53 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:00:53 user nova-compute[72929]:     </video>
Aug 26 22:00:53 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:00:53 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:00:53 user nova-compute[72929]:     </rng>
Aug 26 22:00:53 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:00:53 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:00:53 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:00:53 user nova-compute[72929]:     </memballoon>
Aug 26 22:00:53 user nova-compute[72929]:   </devices>
Aug 26 22:00:53 user nova-compute[72929]: </domain>
Aug 26 22:00:53 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1642304118',display_name='tempest-ServerActionsTestOtherA-server-1642304118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1642304118',id=14,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-1nlxy90r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=c1608933-05ed-4314-a13b-a48035aa841b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG os_vif [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c43ee94-08, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c43ee94-08, col_values=(('external_ids', {'iface-id': '8c43ee94-0853-4850-95f1-3f889602ec01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:4d:d3', 'vm-uuid': 'c1608933-05ed-4314-a13b-a48035aa841b'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:53 user nova-compute[72929]: INFO os_vif [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08')
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No VIF found with MAC fa:16:3e:c6:4d:d3, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updated VIF entry in instance network info cache for port 8c43ee94-0853-4850-95f1-3f889602ec01. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:00:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fead5ec7-19e0-449f-8f09-c46c7eb29306 req-51eb9a8d-8edd-4867-8404-bfc6d329a816 service nova] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:00:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087255.0696635, c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] VM Resumed (Lifecycle Event)
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] No waiting events found dispatching network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:55 user nova-compute[72929]: WARNING nova.compute.manager [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received unexpected event network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c for instance with vm_state building and task_state spawning.
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] No waiting events found dispatching network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:55 user nova-compute[72929]: WARNING nova.compute.manager [req-f21c62fd-be75-467a-95d7-c2b21aa468db req-c550984b-66fd-4398-aa74-72b4c11937af service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received unexpected event network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 for instance with vm_state building and task_state spawning.
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Instance spawned successfully.
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087255.0772862, c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] VM Started (Lifecycle Event)
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Took 6.92 seconds to spawn the instance on the hypervisor.
Aug 26 22:00:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:55 user nova-compute[72929]: INFO nova.compute.manager [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Took 7.80 seconds to build instance.
Aug 26 22:00:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-88f8932e-e2b7-4391-a36e-11b898c3e26e tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.927s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087256.8548439, c1608933-05ed-4314-a13b-a48035aa841b => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:56 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] VM Resumed (Lifecycle Event)
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:00:56 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Instance spawned successfully.
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:00:56 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:00:56 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087256.8564262, c1608933-05ed-4314-a13b-a48035aa841b => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:00:56 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] VM Started (Lifecycle Event)
Aug 26 22:00:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:00:57 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:00:57 user nova-compute[72929]: INFO nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Took 5.69 seconds to spawn the instance on the hypervisor.
Aug 26 22:00:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:00:57 user nova-compute[72929]: INFO nova.compute.manager [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Took 6.46 seconds to build instance.
Aug 26 22:00:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-e4254943-ed97-4f90-9c07-fddfa829d1c3 req-92017709-03d2-4ea4-b390-0046a516139c service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:00:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e4254943-ed97-4f90-9c07-fddfa829d1c3 req-92017709-03d2-4ea4-b390-0046a516139c service nova] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:00:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e4254943-ed97-4f90-9c07-fddfa829d1c3 req-92017709-03d2-4ea4-b390-0046a516139c service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:00:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e4254943-ed97-4f90-9c07-fddfa829d1c3 req-92017709-03d2-4ea4-b390-0046a516139c service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-e4254943-ed97-4f90-9c07-fddfa829d1c3 req-92017709-03d2-4ea4-b390-0046a516139c service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] No waiting events found dispatching network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:00:57 user nova-compute[72929]: WARNING nova.compute.manager [req-e4254943-ed97-4f90-9c07-fddfa829d1c3 req-92017709-03d2-4ea4-b390-0046a516139c service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received unexpected event network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 for instance with vm_state building and task_state spawning.
Aug 26 22:00:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5571463d-f62a-4774-9a88-c70f6f525018 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "c1608933-05ed-4314-a13b-a48035aa841b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.558s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:00:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:00:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:01:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:01:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:01:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:10 user nova-compute[72929]: INFO nova.compute.manager [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Terminating instance
Aug 26 22:01:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-12db7a42-ad87-4825-ae92-a0c411aca882 req-9368ad7a-7954-4ae9-890c-6042eef2ccdd service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-unplugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-12db7a42-ad87-4825-ae92-a0c411aca882 req-9368ad7a-7954-4ae9-890c-6042eef2ccdd service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-12db7a42-ad87-4825-ae92-a0c411aca882 req-9368ad7a-7954-4ae9-890c-6042eef2ccdd service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-12db7a42-ad87-4825-ae92-a0c411aca882 req-9368ad7a-7954-4ae9-890c-6042eef2ccdd service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-12db7a42-ad87-4825-ae92-a0c411aca882 req-9368ad7a-7954-4ae9-890c-6042eef2ccdd service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-unplugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-12db7a42-ad87-4825-ae92-a0c411aca882 req-9368ad7a-7954-4ae9-890c-6042eef2ccdd service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-unplugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Instance destroyed successfully.
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lazy-loading 'resources' on Instance uuid f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1426573410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1426573410',id=8,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf6Hbein/aDLREcIOI0F8ihRx4vVrigpLNDEq626I65FQbMleGopsRV9v3NmZQMugPs5cNFMkkQpmGaKoTEGsnCoK5cNqM+Qi5KM45uqQk1u+YWBdStugUFTj4jjrCI7g==',key_name='tempest-keypair-1963281091',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='459f54f128ef4e719c81a1eb92eb817d',ramdisk_id='',reservation_id='r-nr7b6lgs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1623013215',owner_user_name='tempest-TaggedAttachmentsTest-1623013215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9347c20c29943a0ada7fbf255609767',uuid=f2ae437b-0e1a-4f23-a1a8-56bd3280ed22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converting VIF {"id": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "address": "fa:16:3e:b6:39:dd", "network": {"id": "4496856b-8cfa-4470-9ece-2da51317333a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1703526057-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "459f54f128ef4e719c81a1eb92eb817d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2079e4a3-b5", "ovs_interfaceid": "2079e4a3-b51b-49d9-a227-899cbd486ae5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG os_vif [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2079e4a3-b5, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:11 user nova-compute[72929]: INFO os_vif [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:39:dd,bridge_name='br-int',has_traffic_filtering=True,id=2079e4a3-b51b-49d9-a227-899cbd486ae5,network=Network(4496856b-8cfa-4470-9ece-2da51317333a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2079e4a3-b5')
Aug 26 22:01:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Deleting instance files /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22_del
Aug 26 22:01:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Deletion of /opt/stack/data/nova/instances/f2ae437b-0e1a-4f23-a1a8-56bd3280ed22_del complete
Aug 26 22:01:11 user nova-compute[72929]: INFO nova.compute.manager [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 22:01:11 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:11 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Took 0.86 seconds to deallocate network for instance.
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-f583761c-1c0c-4b02-b669-c5f13325b0fb req-838a8ff2-65df-4d1a-8073-e54a014a9b54 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-deleted-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:11 user nova-compute[72929]: INFO nova.compute.manager [req-f583761c-1c0c-4b02-b669-c5f13325b0fb req-838a8ff2-65df-4d1a-8073-e54a014a9b54 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Neutron deleted interface 2079e4a3-b51b-49d9-a227-899cbd486ae5; detaching it from the instance and deleting it from the info cache
Aug 26 22:01:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-f583761c-1c0c-4b02-b669-c5f13325b0fb req-838a8ff2-65df-4d1a-8073-e54a014a9b54 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-f583761c-1c0c-4b02-b669-c5f13325b0fb req-838a8ff2-65df-4d1a-8073-e54a014a9b54 service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Detach interface failed, port_id=2079e4a3-b51b-49d9-a227-899cbd486ae5, reason: Instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:12 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Deleted allocations for instance f2ae437b-0e1a-4f23-a1a8-56bd3280ed22
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b000d18c-20bc-4539-87da-4f32e5c3bc42 tempest-TaggedAttachmentsTest-1623013215 tempest-TaggedAttachmentsTest-1623013215-project-member] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.260s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-2043be43-c6ae-4226-acba-2e13b4f36d3b req-c8acdbda-723e-4c0b-8fca-b9b4bdf3ff6c service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received event network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2043be43-c6ae-4226-acba-2e13b4f36d3b req-c8acdbda-723e-4c0b-8fca-b9b4bdf3ff6c service nova] Acquiring lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2043be43-c6ae-4226-acba-2e13b4f36d3b req-c8acdbda-723e-4c0b-8fca-b9b4bdf3ff6c service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2043be43-c6ae-4226-acba-2e13b4f36d3b req-c8acdbda-723e-4c0b-8fca-b9b4bdf3ff6c service nova] Lock "f2ae437b-0e1a-4f23-a1a8-56bd3280ed22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-2043be43-c6ae-4226-acba-2e13b4f36d3b req-c8acdbda-723e-4c0b-8fca-b9b4bdf3ff6c service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] No waiting events found dispatching network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:12 user nova-compute[72929]: WARNING nova.compute.manager [req-2043be43-c6ae-4226-acba-2e13b4f36d3b req-c8acdbda-723e-4c0b-8fca-b9b4bdf3ff6c service nova] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Received unexpected event network-vif-plugged-2079e4a3-b51b-49d9-a227-899cbd486ae5 for instance with vm_state deleted and task_state None.
Aug 26 22:01:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:01:15 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:15 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:01:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:01:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:01:15 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updating instance_info_cache with network_info: [{"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:19 user nova-compute[72929]: WARNING nova.compute.manager [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Timeout waiting for ['volume-reimaged-f6720532-a4f1-4993-b026-4dac16524e10'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-f6720532-a4f1-4993-b026-4dac16524e10: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Aug 26 22:01:19 user nova-compute[72929]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7f0b98287220 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Aug 26 22:01:19 user nova-compute[72929]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:20 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:01:20 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7400MB free_disk=24.441692352294922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.901s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:20 user nova-compute[72929]: INFO nova.compute.manager [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Successfully reverted task state from rebuilding on failure for instance.
Aug 26 22:01:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.166s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server [None req-33eefbb8-ed97-4a05-baa2-612f9abfcaec tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Exception during message handling: ValueError: Circular reference detected
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3841, in rebuild_instance
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3927, in _do_rebuild_instance_with_claim
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4119, in _do_rebuild_instance
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3697, in _rebuild_default_impl
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3617, in _rebuild_volume_backed_instance
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     next(self.gen)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server 
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server 
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Aug 26 22:01:20 user nova-compute[72929]: ERROR oslo_messaging.rpc.server 
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 90e97032-f5f1-412a-b74a-50528262e6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 67091d20-1923-4efb-92eb-f11df34f85e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5333d644-7490-4e03-ba39-63168ffd4d12 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:01:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:22 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:22 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:01:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:26 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087271.0137174, f2ae437b-0e1a-4f23-a1a8-56bd3280ed22 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:01:26 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] VM Stopped (Lifecycle Event)
Aug 26 22:01:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a9bc6077-926e-4587-85c3-923ccf7c8d6b None None] [instance: f2ae437b-0e1a-4f23-a1a8-56bd3280ed22] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:28 user nova-compute[72929]: INFO nova.compute.manager [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Unshelving
Aug 26 22:01:28 user nova-compute[72929]: INFO nova.virt.block_device [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Booting with volume 8ffe740a-3857-4c23-9a0e-6fdec2f374bb at /dev/vdc
Aug 26 22:01:28 user nova-compute[72929]: DEBUG os_brick.utils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5861f3a-5127-4cf8-b26d-8ca4fa598e6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10eb36e-b0a2-4609-b11f-65918c2fa677]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[039307dc-7f58-4e97-b321-c9143e92243f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[92555bc6-3ce8-41aa-90cf-98e2cf3afe90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:01:28 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[31493b21-b3d0-4213-a256-44f53c78927a]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG os_brick.utils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating existing volume attachment record: b29c9e46-cb02-4270-8f33-431ae38362de {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:28 user nova-compute[72929]: INFO nova.compute.manager [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Terminating instance
Aug 26 22:01:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-6fca9a18-f30c-494f-b7af-bc735c2a70dc req-2b73e42b-3ba5-498a-a092-616e3ce4a651 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-vif-unplugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6fca9a18-f30c-494f-b7af-bc735c2a70dc req-2b73e42b-3ba5-498a-a092-616e3ce4a651 service nova] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6fca9a18-f30c-494f-b7af-bc735c2a70dc req-2b73e42b-3ba5-498a-a092-616e3ce4a651 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6fca9a18-f30c-494f-b7af-bc735c2a70dc req-2b73e42b-3ba5-498a-a092-616e3ce4a651 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-6fca9a18-f30c-494f-b7af-bc735c2a70dc req-2b73e42b-3ba5-498a-a092-616e3ce4a651 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] No waiting events found dispatching network-vif-unplugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-6fca9a18-f30c-494f-b7af-bc735c2a70dc req-2b73e42b-3ba5-498a-a092-616e3ce4a651 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-vif-unplugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Instance destroyed successfully.
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lazy-loading 'resources' on Instance uuid 67091d20-1923-4efb-92eb-f11df34f85e6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-330826468',display_name='tempest-VolumesAssistedSnapshotsTest-server-330826468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-330826468',id=9,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0xEDb2N54R4Uuocy5VFEB1kJoGLKLPiZa94rce3jrRqvMXBMKRrjob3+NC46MtjNM/+SBzIf2duTz10PVNlOSwbodNEgwf5hRTRZ6Yhg15OcUVaQBVJ/2ukrvXZ/EUfw==',key_name='tempest-keypair-1953641866',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a3175ac07ae4981b077b8784d400128',ramdisk_id='',reservation_id='r-0y9y4hvm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1508098153',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1508098153-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bd415650cc944de985461a450373f79',uuid=67091d20-1923-4efb-92eb-f11df34f85e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Converting VIF {"id": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "address": "fa:16:3e:13:a1:f6", "network": {"id": "c1c1eb6a-e701-4efe-b24d-78c7ee74e020", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1335304248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a3175ac07ae4981b077b8784d400128", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabd9caaa-30", "ovs_interfaceid": "abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG os_vif [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabd9caaa-30, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:29 user nova-compute[72929]: INFO os_vif [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:a1:f6,bridge_name='br-int',has_traffic_filtering=True,id=abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab,network=Network(c1c1eb6a-e701-4efe-b24d-78c7ee74e020),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabd9caaa-30')
Aug 26 22:01:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Deleting instance files /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6_del
Aug 26 22:01:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Deletion of /opt/stack/data/nova/instances/67091d20-1923-4efb-92eb-f11df34f85e6_del complete
Aug 26 22:01:30 user nova-compute[72929]: INFO nova.compute.manager [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 26 22:01:30 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:01:30 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:01:30 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:01:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:31 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Took 1.33 seconds to deallocate network for instance.
Aug 26 22:01:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-1d86f9b3-9bf7-4c52-85ff-faa12300b6d7 req-51c58d00-e178-4c4d-8e39-0b73b27d7106 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-vif-deleted-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-61d4f122-63a8-4e83-8512-091ae9a01aba req-216e894f-4db8-400b-99f2-96ccdef4a4c3 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received event network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-61d4f122-63a8-4e83-8512-091ae9a01aba req-216e894f-4db8-400b-99f2-96ccdef4a4c3 service nova] Acquiring lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-61d4f122-63a8-4e83-8512-091ae9a01aba req-216e894f-4db8-400b-99f2-96ccdef4a4c3 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-61d4f122-63a8-4e83-8512-091ae9a01aba req-216e894f-4db8-400b-99f2-96ccdef4a4c3 service nova] Lock "67091d20-1923-4efb-92eb-f11df34f85e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-61d4f122-63a8-4e83-8512-091ae9a01aba req-216e894f-4db8-400b-99f2-96ccdef4a4c3 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] No waiting events found dispatching network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:31 user nova-compute[72929]: WARNING nova.compute.manager [req-61d4f122-63a8-4e83-8512-091ae9a01aba req-216e894f-4db8-400b-99f2-96ccdef4a4c3 service nova] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Received unexpected event network-vif-plugged-abd9caaa-30e5-44ea-9ab0-89ad8a26a5ab for instance with vm_state active and task_state deleting.
Aug 26 22:01:31 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:31 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Deleted allocations for instance 67091d20-1923-4efb-92eb-f11df34f85e6
Aug 26 22:01:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7e10ad92-36a8-439a-a43d-1db0466ce82c tempest-VolumesAssistedSnapshotsTest-1508098153 tempest-VolumesAssistedSnapshotsTest-1508098153-project-member] Lock "67091d20-1923-4efb-92eb-f11df34f85e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.070s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-changed-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Refreshing instance network info cache due to event network-changed-e55d4fb5-4832-428f-9379-faa4e3ffb801. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] Acquiring lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] Acquired lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Refreshing network info cache for port e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:01:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "5333d644-7490-4e03-ba39-63168ffd4d12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:35 user nova-compute[72929]: INFO nova.compute.manager [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Terminating instance
Aug 26 22:01:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-d28a09f2-e750-480b-9c7e-c41320be4114 req-d072da04-b13c-4029-97c2-686bef112e46 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-vif-unplugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d28a09f2-e750-480b-9c7e-c41320be4114 req-d072da04-b13c-4029-97c2-686bef112e46 service nova] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d28a09f2-e750-480b-9c7e-c41320be4114 req-d072da04-b13c-4029-97c2-686bef112e46 service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d28a09f2-e750-480b-9c7e-c41320be4114 req-d072da04-b13c-4029-97c2-686bef112e46 service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-d28a09f2-e750-480b-9c7e-c41320be4114 req-d072da04-b13c-4029-97c2-686bef112e46 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] No waiting events found dispatching network-vif-unplugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-d28a09f2-e750-480b-9c7e-c41320be4114 req-d072da04-b13c-4029-97c2-686bef112e46 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-vif-unplugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Instance destroyed successfully.
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'resources' on Instance uuid 5333d644-7490-4e03-ba39-63168ffd4d12 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:59:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-511598667',display_name='tempest-AttachVolumeNegativeTest-server-511598667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-511598667',id=12,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdsrCwmFngvQvYs2C/I+pyb5aQk0B1FLWBICiW3FCiW5N/0KTaFkIIpRK5Csx9EqXYzrR5zmuQG/a5/QzA5GfqZBOzKEd77xxE1gEvGoreWM1nAeBhlv7adDz2krVDkDA==',key_name='tempest-keypair-147163806',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:59:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-7rgrtbdi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:59:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=5333d644-7490-4e03-ba39-63168ffd4d12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG os_vif [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape55d4fb5-48, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:36 user nova-compute[72929]: INFO os_vif [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:ad:d9,bridge_name='br-int',has_traffic_filtering=True,id=e55d4fb5-4832-428f-9379-faa4e3ffb801,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape55d4fb5-48')
Aug 26 22:01:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Deleting instance files /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12_del
Aug 26 22:01:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Deletion of /opt/stack/data/nova/instances/5333d644-7490-4e03-ba39-63168ffd4d12_del complete
Aug 26 22:01:36 user nova-compute[72929]: INFO nova.compute.manager [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 26 22:01:36 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Updated VIF entry in instance network info cache for port e55d4fb5-4832-428f-9379-faa4e3ffb801. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Updating instance_info_cache with network_info: [{"id": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "address": "fa:16:3e:72:ad:d9", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape55d4fb5-48", "ovs_interfaceid": "e55d4fb5-4832-428f-9379-faa4e3ffb801", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10c8f921-854f-42ed-b23e-6535249837a9 req-0f83f2fe-07c4-4dc4-a6a9-814d2e1de683 service nova] Releasing lock "refresh_cache-5333d644-7490-4e03-ba39-63168ffd4d12" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-changed-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing instance network info cache due to event network-changed-d359e5a7-2499-40d3-9b7c-e269a2120ade. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] Acquiring lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] Acquired lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:01:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Refreshing network info cache for port d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:37 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Took 0.90 seconds to deallocate network for instance.
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-462e7713-e2a4-4fc0-80f8-b282e5a73b49 req-44600491-81a4-4161-8548-8e4a8c218c80 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-462e7713-e2a4-4fc0-80f8-b282e5a73b49 req-44600491-81a4-4161-8548-8e4a8c218c80 service nova] Acquiring lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-462e7713-e2a4-4fc0-80f8-b282e5a73b49 req-44600491-81a4-4161-8548-8e4a8c218c80 service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-462e7713-e2a4-4fc0-80f8-b282e5a73b49 req-44600491-81a4-4161-8548-8e4a8c218c80 service nova] Lock "5333d644-7490-4e03-ba39-63168ffd4d12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-462e7713-e2a4-4fc0-80f8-b282e5a73b49 req-44600491-81a4-4161-8548-8e4a8c218c80 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] No waiting events found dispatching network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:37 user nova-compute[72929]: WARNING nova.compute.manager [req-462e7713-e2a4-4fc0-80f8-b282e5a73b49 req-44600491-81a4-4161-8548-8e4a8c218c80 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received unexpected event network-vif-plugged-e55d4fb5-4832-428f-9379-faa4e3ffb801 for instance with vm_state deleted and task_state None.
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updated VIF entry in instance network info cache for port d359e5a7-2499-40d3-9b7c-e269a2120ade. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:37 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Deleted allocations for instance 5333d644-7490-4e03-ba39-63168ffd4d12
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2503cd3b-1f83-4678-b4fa-1300fc01c547 req-baa2b84d-3227-458b-9a5c-334a0a3ad521 service nova] Releasing lock "refresh_cache-16208bfb-7bef-44b7-bf18-d5ce38e31fa8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4a7f8103-0fb3-43b1-ac1c-b26805c88994 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "5333d644-7490-4e03-ba39-63168ffd4d12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-0334fa25-bdf3-4ead-9a22-c8de9d872f7d req-38c8d936-8540-4550-9f0b-04c587776a83 service nova] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Received event network-vif-deleted-e55d4fb5-4832-428f-9379-faa4e3ffb801 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:39 user nova-compute[72929]: INFO nova.compute.manager [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Terminating instance
Aug 26 22:01:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-06b28800-5ae8-4a83-b2eb-eecf4a1ce936 req-ac5f18f7-b8a8-461e-9551-491332549324 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-06b28800-5ae8-4a83-b2eb-eecf4a1ce936 req-ac5f18f7-b8a8-461e-9551-491332549324 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-06b28800-5ae8-4a83-b2eb-eecf4a1ce936 req-ac5f18f7-b8a8-461e-9551-491332549324 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-06b28800-5ae8-4a83-b2eb-eecf4a1ce936 req-ac5f18f7-b8a8-461e-9551-491332549324 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-06b28800-5ae8-4a83-b2eb-eecf4a1ce936 req-ac5f18f7-b8a8-461e-9551-491332549324 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-06b28800-5ae8-4a83-b2eb-eecf4a1ce936 req-ac5f18f7-b8a8-461e-9551-491332549324 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-e1e0f157-2aa3-44df-ae17-71c2e119e88a req-cd1b3029-fab5-433d-917a-cd4ab0f82514 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e1e0f157-2aa3-44df-ae17-71c2e119e88a req-cd1b3029-fab5-433d-917a-cd4ab0f82514 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e1e0f157-2aa3-44df-ae17-71c2e119e88a req-cd1b3029-fab5-433d-917a-cd4ab0f82514 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e1e0f157-2aa3-44df-ae17-71c2e119e88a req-cd1b3029-fab5-433d-917a-cd4ab0f82514 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-e1e0f157-2aa3-44df-ae17-71c2e119e88a req-cd1b3029-fab5-433d-917a-cd4ab0f82514 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-e1e0f157-2aa3-44df-ae17-71c2e119e88a req-cd1b3029-fab5-433d-917a-cd4ab0f82514 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-d359e5a7-2499-40d3-9b7c-e269a2120ade for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:40 user nova-compute[72929]: WARNING nova.compute.manager [req-05538902-c30e-455b-8e0e-5a0f4ee13cd1 req-22411e55-5980-4008-966e-d89134071f6a service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-d359e5a7-2499-40d3-9b7c-e269a2120ade for instance with vm_state active and task_state deleting.
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Instance destroyed successfully.
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.objects.instance [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lazy-loading 'resources' on Instance uuid 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd359e5a7-24, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:30:45,bridge_name='br-int',has_traffic_filtering=True,id=d359e5a7-2499-40d3-9b7c-e269a2120ade,network=Network(b26ebd39-fcde-4954-9d24-2a4e157d23d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd359e5a7-24')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap171a196d-bc, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:33:00,bridge_name='br-int',has_traffic_filtering=True,id=171a196d-bcf5-4522-a18a-e5b7267a67f2,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap171a196d-bc')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape61229de-f1, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:0b:aa,bridge_name='br-int',has_traffic_filtering=True,id=e61229de-f1d1-4f96-8f3c-e4cae5e871b0,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape61229de-f1')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d9eb10a-c2, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:c5:c4,bridge_name='br-int',has_traffic_filtering=True,id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9eb10a-c2')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b7e5c06-a5, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:0e:57,bridge_name='br-int',has_traffic_filtering=True,id=2b7e5c06-a545-4009-a95f-dae7ecee44f6,network=Network(7d23ea0a-a0d6-4c30-9de7-155749716291),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b7e5c06-a5')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71b71ee5-cf, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ed:d4,bridge_name='br-int',has_traffic_filtering=True,id=71b71ee5-cff0-495d-a247-75f7252edba0,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b71ee5-cf')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T21:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-706041319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-706041319',id=11,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJkw4d6zEjPz4w1OUqhR4cxh0SXcVs4nkC6K9A3w3zwGdyeHWIPd2ROaGtDaokJCW14uwwwH6IomYnSQQj0O1oNkQDuLYQ+iDBVIY3ovS6ppka+IuHfhAvIDVCGzdUUkQ==',key_name='tempest-keypair-11865989',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='457688283de340618fb3506750a7c737',ramdisk_id='',reservation_id='r-qvdk5fmr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2081995986',owner_user_name='tempest-TaggedBootDevicesTest-2081995986-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cafed116bbc9411dbff17af1b2b34792',uuid=16208bfb-7bef-44b7-bf18-d5ce38e31fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converting VIF {"id": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "address": "fa:16:3e:4f:2c:4c", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a82b2b-f3", "ovs_interfaceid": "d2a82b2b-f386-45ff-9108-ee0597716cb1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a82b2b-f3, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:41 user nova-compute[72929]: INFO os_vif [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:2c:4c,bridge_name='br-int',has_traffic_filtering=True,id=d2a82b2b-f386-45ff-9108-ee0597716cb1,network=Network(571e3114-066a-4e91-919c-5e4de1b474fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a82b2b-f3')
Aug 26 22:01:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cfWJwNRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:01:41 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67142bab-9019-4700-b6ed-41f09cc259a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e963cda-64a0-4391-9fd6-f2c4df712baa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:01:41 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:41 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:01:41 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:01:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:01:41 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:41 user nova-compute[72929]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 (non-flash)
Aug 26 22:01:41 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:01:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803b0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1'): ({'sdf'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Removing single pathed devices sdf {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd48353-ee80-4954-8b8f-55d7ef681a0d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f57b3-83df-4658-957f-de3767c8d9d1]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Flushing IO for device /dev/sdf {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc62568-2210-48f7-9426-9042b13cdf3b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eba5dcf-4abf-45f5-8ac4-099c674e1636]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c4ad8f-7a68-49c1-91df-79d57e3db768]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675a983-41ac-4ad7-a342-e8f2bee16370]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260]
Aug 26 22:01:42 user nova-compute[72929]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1, portal: 172.16.0.220,3260] successful.
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:136d902b-c078-43d7-9b3f-80b38442bec1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f9437b-9cae-422d-9820-1a58ee5c2ed3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== disconnect_volume: return (317ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wtJLWrgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32b176c-4ddf-4711-8fd4-d1dae19dea96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'pci_requests' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ff8da-d7e9-40d9-8fe4-6c363c3fd9e5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:01:42 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:42 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:01:42 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:42 user nova-compute[72929]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 (non-flash)
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804ed5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'numa_topology' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:01:42 user nova-compute[72929]: INFO nova.compute.claims [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Claim successful on node user
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49a7797-427f-4a76-ab10-3593bdad9726]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[16abc46d-a52a-4d46-8048-fb1b28713742]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[346ed50d-89ca-4065-9e34-9ca456b9ec05]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-171a196d-bcf5-4522-a18a-e5b7267a67f2 for instance with vm_state active and task_state deleting.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 for instance with vm_state active and task_state deleting.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING nova.compute.manager [req-dccab5fd-3245-4a60-9c16-421b117cc0df req-ffe1153a-0fc6-4642-a2f6-8e0de93e058b service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-2b7e5c06-a545-4009-a95f-dae7ecee44f6 for instance with vm_state active and task_state deleting.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c6747b-c2be-48c1-9f86-b4635dc7e702]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea7dc04-4803-4936-81a8-52dee375343c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9636048a-c825-4e1e-90b3-447009d5b403]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260]
Aug 26 22:01:42 user nova-compute[72929]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340, portal: 172.16.0.220,3260] successful.
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7046cf6-d3ae-4109-bfce-b6278ac12340 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7993f66-c4bd-4c91-8b4c-8106d7c5b7bd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== disconnect_volume: return (321ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhqNAFUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bc159e-26f2-4455-ace5-2a1c28a93312]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-e61229de-f1d1-4f96-8f3c-e4cae5e871b0 for instance with vm_state active and task_state deleting.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-71b71ee5-cff0-495d-a247-75f7252edba0 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING nova.compute.manager [req-c2547c8d-cddd-4d03-91c7-7bcc14bfb539 req-fc69bd2a-dbce-413a-975a-96a75fd205e1 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-71b71ee5-cff0-495d-a247-75f7252edba0 for instance with vm_state active and task_state deleting.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b81062-1813-4469-957f-9ff9f121001c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:01:42 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a (non-flash)
Aug 26 22:01:42 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803b0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc87c25-be56-465f-8ea0-27a20f9887a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[804988d1-27b3-45ce-845c-0e4a56639b49]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb0ddca-8c5d-4ee7-a2a9-85a9b480ebb5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b4794-ec77-4cae-aa04-ddb1e9338aa1]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2157b4-3516-464a-b66d-8fc02f8f4fce]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-unplugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-unplugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] Acquiring lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] No waiting events found dispatching network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:42 user nova-compute[72929]: WARNING nova.compute.manager [req-02623c85-aa1a-4c0a-825d-0f74e6e70f3d req-f6f3c581-b1a0-428d-a371-c680ff063923 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received unexpected event network-vif-plugged-d2a82b2b-f386-45ff-9108-ee0597716cb1 for instance with vm_state active and task_state deleting.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33fb03-c0cb-4396-8e0b-87a5192c6ef9]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260]
Aug 26 22:01:42 user nova-compute[72929]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a, portal: 172.16.0.220,3260] successful.
Aug 26 22:01:42 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f7f1008-22bb-4a2c-bfdd-f066cd82c35a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c891ef3-a62e-4ec6-ac98-2bd037d5a1f0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] <== disconnect_volume: return (286ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:01:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Deleting instance files /opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8_del
Aug 26 22:01:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Deletion of /opt/stack/data/nova/instances/16208bfb-7bef-44b7-bf18-d5ce38e31fa8_del complete
Aug 26 22:01:42 user nova-compute[72929]: INFO nova.network.neutron [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating port b33f29b7-cf46-4503-ab4e-b067767186ed with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 22:01:42 user nova-compute[72929]: INFO nova.compute.manager [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Took 3.25 seconds to destroy the instance on the hypervisor.
Aug 26 22:01:42 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:01:42 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:01:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing instance network info cache due to event network-changed-b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:01:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Creating image(s)
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'trusted_certs' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Refreshing network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG nova.objects.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<925086ad-8a40-40e1-a537-a00923a0dd3f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087289.8217137, 67091d20-1923-4efb-92eb-f11df34f85e6 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:01:46 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] VM Stopped (Lifecycle Event)
Aug 26 22:01:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e80a0a30-3791-40b5-8af4-b337d6a4cc6c None None] [instance: 67091d20-1923-4efb-92eb-f11df34f85e6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.part --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG nova.virt.images [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] 7e4e83f6-2924-47e1-8941-c82579c55681 was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.part /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.part /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.converted" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updated VIF entry in instance network info cache for port b33f29b7-cf46-4503-ab4e-b067767186ed. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-632eb099-283f-40be-94dd-2f4b7d9da56b req-d4124ccd-e5cb-4f87-8d8a-9c74a0adacc0 service nova] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.942s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c,backing_fmt=raw /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c,backing_fmt=raw /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk 1073741824" returned: 0 in 0.068s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'migration_context' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG nova.objects.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<925086ad-8a40-40e1-a537-a00923a0dd3f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:01:47 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Rebasing disk image.
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-809f181e-ec25-4119-8b16-42c7f5739d02 req-3b31cfea-7fda-4595-a08a-bbb7020bf441 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-deleted-d2a82b2b-f386-45ff-9108-ee0597716cb1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:47 user nova-compute[72929]: INFO nova.compute.manager [req-809f181e-ec25-4119-8b16-42c7f5739d02 req-3b31cfea-7fda-4595-a08a-bbb7020bf441 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Neutron deleted interface d2a82b2b-f386-45ff-9108-ee0597716cb1; detaching it from the instance and deleting it from the info cache
Aug 26 22:01:47 user nova-compute[72929]: DEBUG nova.network.neutron [req-809f181e-ec25-4119-8b16-42c7f5739d02 req-3b31cfea-7fda-4595-a08a-bbb7020bf441 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "address": "fa:16:3e:e6:c5:c4", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.209", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9eb10a-c2", "ovs_interfaceid": "0d9eb10a-c2b8-438e-9e48-c58fb2e72098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-809f181e-ec25-4119-8b16-42c7f5739d02 req-3b31cfea-7fda-4595-a08a-bbb7020bf441 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Detach interface failed, port_id=d2a82b2b-f386-45ff-9108-ee0597716cb1, reason: Instance 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 -F raw /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-09d739e3-3998-4311-842e-7be036a0281e req-edc8065a-d76b-4129-a0ff-d5d1063ad28c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-deleted-0d9eb10a-c2b8-438e-9e48-c58fb2e72098 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:49 user nova-compute[72929]: INFO nova.compute.manager [req-09d739e3-3998-4311-842e-7be036a0281e req-edc8065a-d76b-4129-a0ff-d5d1063ad28c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Neutron deleted interface 0d9eb10a-c2b8-438e-9e48-c58fb2e72098; detaching it from the instance and deleting it from the info cache
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-09d739e3-3998-4311-842e-7be036a0281e req-edc8065a-d76b-4129-a0ff-d5d1063ad28c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [{"id": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "address": "fa:16:3e:c6:30:45", "network": {"id": "b26ebd39-fcde-4954-9d24-2a4e157d23d4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-371168621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd359e5a7-24", "ovs_interfaceid": "d359e5a7-2499-40d3-9b7c-e269a2120ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "address": "fa:16:3e:a5:33:00", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171a196d-bc", "ovs_interfaceid": "171a196d-bcf5-4522-a18a-e5b7267a67f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "address": "fa:16:3e:ab:0b:aa", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.125", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape61229de-f1", "ovs_interfaceid": "e61229de-f1d1-4f96-8f3c-e4cae5e871b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "address": "fa:16:3e:08:0e:57", "network": {"id": "7d23ea0a-a0d6-4c30-9de7-155749716291", "bridge": "br-int", "label": "tempest-device-tagging-net1-542885812", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b7e5c06-a5", "ovs_interfaceid": "2b7e5c06-a545-4009-a95f-dae7ecee44f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "71b71ee5-cff0-495d-a247-75f7252edba0", "address": "fa:16:3e:b2:ed:d4", "network": {"id": "571e3114-066a-4e91-919c-5e4de1b474fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-1055343806", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "457688283de340618fb3506750a7c737", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b71ee5-cf", "ovs_interfaceid": "71b71ee5-cff0-495d-a247-75f7252edba0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-09d739e3-3998-4311-842e-7be036a0281e req-edc8065a-d76b-4129-a0ff-d5d1063ad28c service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Detach interface failed, port_id=0d9eb10a-c2b8-438e-9e48-c58fb2e72098, reason: Instance 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 -F raw /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk" returned: 0 in 2.123s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Ensure instance console log exists: /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Start _get_guest_xml network_info=[{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='a1c0dac3dc2a16b7c90284370cee5037',container_format='bare',created_at=2023-08-26T21:59:36Z,direct_url=<?>,disk_format='qcow2',id=7e4e83f6-2924-47e1-8941-c82579c55681,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-584320566-shelved',owner='22dd3139d0af4e319ee02bff3155650b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T21:59:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'b29c9e46-cb02-4270-8f33-431ae38362de', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnCyLzZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '925086ad-8a40-40e1-a537-a00923a0dd3f', 'attached_at': '', 'detached_at': '', 'volume_id': '8ffe740a-3857-4c23-9a0e-6fdec2f374bb', 'serial': '8ffe740a-3857-4c23-9a0e-6fdec2f374bb'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:01:49 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:01:49 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a1c0dac3dc2a16b7c90284370cee5037',container_format='bare',created_at=2023-08-26T21:59:36Z,direct_url=<?>,disk_format='qcow2',id=7e4e83f6-2924-47e1-8941-c82579c55681,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-584320566-shelved',owner='22dd3139d0af4e319ee02bff3155650b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T21:59:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.objects.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<925086ad-8a40-40e1-a537-a00923a0dd3f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnCyLzZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:01:49 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:01:49 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:01:49 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260" returned: 21 in 0.147s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f6d766-13c1-44b8-97c8-86f14f83844c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:01:49 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b507240-9d3a-4785-97f7-3c16a4aacd36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb] added
Aug 26 22:01:49 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea067e29-2b41-4b2c-b628-c267859716c2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0587053a-4608-45fd-bb9e-378b46bd37ae]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnCyLzZN {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rnCyLzZN" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54ecd3f-065a-47e2-8ce5-376e5ec7bc6c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rnCyLzZN'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77e52d-917c-41b2-8572-56e71fc0e2d6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c6586f-9f60-4d49-90c1-5b7259ac86b8]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[032981a2-5d57-4c73-b1ff-07fc9a1fcc8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260]
Aug 26 22:01:50 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260] successful.
Aug 26 22:01:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afe0d76-474a-4007-989b-dbfb91bf4a62]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[009022ed-6997-4038-b6a5-887df2df7b31]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:01:50 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:01:50 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:01:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1f5297-27b4-4018-9889-21acaa1085b2]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnCyLzZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:01:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:01:50 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Took 7.79 seconds to deallocate network for instance.
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087296.1191778, 5333d644-7490-4e03-ba39-63168ffd4d12 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:01:51 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] VM Stopped (Lifecycle Event)
Aug 26 22:01:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23765383435356335', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765383435356335', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5380a139-9487-47ba-8190-72de23cdd8fe None None] [instance: 5333d644-7490-4e03-ba39-63168ffd4d12] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584320566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584320566',id=5,image_ref='7e4e83f6-2924-47e1-8941-c82579c55681',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-144813694',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-6z0hzvy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member',shelved_at='2023-08-26T21:59:40.548343',shelved_host='user',shelved_image_id='7e4e83f6-2924-47e1-8941-c82579c55681'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=925086ad-8a40-40e1-a537-a00923a0dd3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'pci_devices' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.objects.base [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<925086ad-8a40-40e1-a537-a00923a0dd3f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:01:51 user nova-compute[72929]:   <uuid>925086ad-8a40-40e1-a537-a00923a0dd3f</uuid>
Aug 26 22:01:51 user nova-compute[72929]:   <name>instance-00000005</name>
Aug 26 22:01:51 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:01:51 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:01:51 user nova-compute[72929]:   <metadata>
Aug 26 22:01:51 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:01:51 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:01:51 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-584320566</nova:name>
Aug 26 22:01:51 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:01:49</nova:creationTime>
Aug 26 22:01:51 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:01:51 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:01:51 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:01:51 user nova-compute[72929]:       <nova:owner>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:user uuid="cf32662e1a4e466781518d4fdd63cb76">tempest-AttachVolumeShelveTestJSON-1476482184-project-member</nova:user>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:project uuid="22dd3139d0af4e319ee02bff3155650b">tempest-AttachVolumeShelveTestJSON-1476482184</nova:project>
Aug 26 22:01:51 user nova-compute[72929]:       </nova:owner>
Aug 26 22:01:51 user nova-compute[72929]:       <nova:root type="image" uuid="7e4e83f6-2924-47e1-8941-c82579c55681"/>
Aug 26 22:01:51 user nova-compute[72929]:       <nova:ports>
Aug 26 22:01:51 user nova-compute[72929]:         <nova:port uuid="b33f29b7-cf46-4503-ab4e-b067767186ed">
Aug 26 22:01:51 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:01:51 user nova-compute[72929]:         </nova:port>
Aug 26 22:01:51 user nova-compute[72929]:       </nova:ports>
Aug 26 22:01:51 user nova-compute[72929]:     </nova:instance>
Aug 26 22:01:51 user nova-compute[72929]:   </metadata>
Aug 26 22:01:51 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:01:51 user nova-compute[72929]:     <system>
Aug 26 22:01:51 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:01:51 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:01:51 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:01:51 user nova-compute[72929]:       <entry name="serial">925086ad-8a40-40e1-a537-a00923a0dd3f</entry>
Aug 26 22:01:51 user nova-compute[72929]:       <entry name="uuid">925086ad-8a40-40e1-a537-a00923a0dd3f</entry>
Aug 26 22:01:51 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:01:51 user nova-compute[72929]:     </system>
Aug 26 22:01:51 user nova-compute[72929]:   </sysinfo>
Aug 26 22:01:51 user nova-compute[72929]:   <os>
Aug 26 22:01:51 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:01:51 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:01:51 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:01:51 user nova-compute[72929]:   </os>
Aug 26 22:01:51 user nova-compute[72929]:   <features>
Aug 26 22:01:51 user nova-compute[72929]:     <acpi/>
Aug 26 22:01:51 user nova-compute[72929]:     <apic/>
Aug 26 22:01:51 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:01:51 user nova-compute[72929]:   </features>
Aug 26 22:01:51 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:01:51 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:01:51 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:01:51 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:01:51 user nova-compute[72929]:   </clock>
Aug 26 22:01:51 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:01:51 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:01:51 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:01:51 user nova-compute[72929]:   </cpu>
Aug 26 22:01:51 user nova-compute[72929]:   <devices>
Aug 26 22:01:51 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:01:51 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:01:51 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk"/>
Aug 26 22:01:51 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:01:51 user nova-compute[72929]:     </disk>
Aug 26 22:01:51 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:01:51 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:01:51 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:01:51 user nova-compute[72929]:       <target dev="vdc" bus="virtio"/>
Aug 26 22:01:51 user nova-compute[72929]:       <serial>8ffe740a-3857-4c23-9a0e-6fdec2f374bb</serial>
Aug 26 22:01:51 user nova-compute[72929]:     </disk>
Aug 26 22:01:51 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:01:51 user nova-compute[72929]:       <mac address="fa:16:3e:83:35:e9"/>
Aug 26 22:01:51 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:01:51 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:01:51 user nova-compute[72929]:       <target dev="tapb33f29b7-cf"/>
Aug 26 22:01:51 user nova-compute[72929]:     </interface>
Aug 26 22:01:51 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:01:51 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/console.log" append="off"/>
Aug 26 22:01:51 user nova-compute[72929]:     </serial>
Aug 26 22:01:51 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:01:51 user nova-compute[72929]:     <video>
Aug 26 22:01:51 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:01:51 user nova-compute[72929]:     </video>
Aug 26 22:01:51 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:01:51 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:01:51 user nova-compute[72929]:     </rng>
Aug 26 22:01:51 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:01:51 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:01:51 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:01:51 user nova-compute[72929]:     </memballoon>
Aug 26 22:01:51 user nova-compute[72929]:   </devices>
Aug 26 22:01:51 user nova-compute[72929]: </domain>
Aug 26 22:01:51 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584320566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584320566',id=5,image_ref='7e4e83f6-2924-47e1-8941-c82579c55681',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-144813694',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-6z0hzvy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member',shelved_at='2023-08-26T21:59:40.548343',shelved_host='user',shelved_image_id='7e4e83f6-2924-47e1-8941-c82579c55681'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=925086ad-8a40-40e1-a537-a00923a0dd3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG os_vif [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb33f29b7-cf, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb33f29b7-cf, col_values=(('external_ids', {'iface-id': 'b33f29b7-cf46-4503-ab4e-b067767186ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:35:e9', 'vm-uuid': '925086ad-8a40-40e1-a537-a00923a0dd3f'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:51 user nova-compute[72929]: INFO os_vif [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf')
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No VIF found with MAC fa:16:3e:83:35:e9, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-6d239a25-581f-4251-87b0-21139f4cc1df req-b2ecbe20-00d3-4436-a36a-fddd755eb3b9 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-deleted-71b71ee5-cff0-495d-a247-75f7252edba0 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-6d239a25-581f-4251-87b0-21139f4cc1df req-b2ecbe20-00d3-4436-a36a-fddd755eb3b9 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-deleted-2b7e5c06-a545-4009-a95f-dae7ecee44f6 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-6d239a25-581f-4251-87b0-21139f4cc1df req-b2ecbe20-00d3-4436-a36a-fddd755eb3b9 service nova] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Received event network-vif-deleted-d359e5a7-2499-40d3-9b7c-e269a2120ade {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e5e1441-eab6-4304-a621-182679367fdc req-0e7348e4-6b22-45dc-a93d-5fb50f53e2ab service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e5e1441-eab6-4304-a621-182679367fdc req-0e7348e4-6b22-45dc-a93d-5fb50f53e2ab service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e5e1441-eab6-4304-a621-182679367fdc req-0e7348e4-6b22-45dc-a93d-5fb50f53e2ab service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0e5e1441-eab6-4304-a621-182679367fdc req-0e7348e4-6b22-45dc-a93d-5fb50f53e2ab service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-0e5e1441-eab6-4304-a621-182679367fdc req-0e7348e4-6b22-45dc-a93d-5fb50f53e2ab service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:53 user nova-compute[72929]: WARNING nova.compute.manager [req-0e5e1441-eab6-4304-a621-182679367fdc req-0e7348e4-6b22-45dc-a93d-5fb50f53e2ab service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 22:01:53 user nova-compute[72929]: INFO nova.compute.manager [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Took 2.65 seconds to detach 3 volumes for instance.
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:53 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Deleted allocations for instance 16208bfb-7bef-44b7-bf18-d5ce38e31fa8
Aug 26 22:01:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-93e8f3f5-1336-4abc-a986-dba82553c12b tempest-TaggedBootDevicesTest-2081995986 tempest-TaggedBootDevicesTest-2081995986-project-member] Lock "16208bfb-7bef-44b7-bf18-d5ce38e31fa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.287s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087315.0565693, 925086ad-8a40-40e1-a537-a00923a0dd3f => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:01:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] VM Resumed (Lifecycle Event)
Aug 26 22:01:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:01:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance spawned successfully.
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:01:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087315.057681, 925086ad-8a40-40e1-a537-a00923a0dd3f => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:01:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] VM Started (Lifecycle Event)
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-aa8ef17e-e397-40af-a798-436666259018 req-b345b300-4490-4e26-bbda-3747adcf65de service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa8ef17e-e397-40af-a798-436666259018 req-b345b300-4490-4e26-bbda-3747adcf65de service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa8ef17e-e397-40af-a798-436666259018 req-b345b300-4490-4e26-bbda-3747adcf65de service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aa8ef17e-e397-40af-a798-436666259018 req-b345b300-4490-4e26-bbda-3747adcf65de service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-aa8ef17e-e397-40af-a798-436666259018 req-b345b300-4490-4e26-bbda-3747adcf65de service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:01:55 user nova-compute[72929]: WARNING nova.compute.manager [req-aa8ef17e-e397-40af-a798-436666259018 req-b345b300-4490-4e26-bbda-3747adcf65de service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:01:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:01:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3205b39-0dae-48d1-b044-942d3a8456e8 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 26.898s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:01:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:56 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087301.3593879, 16208bfb-7bef-44b7-bf18-d5ce38e31fa8 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:01:56 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] VM Stopped (Lifecycle Event)
Aug 26 22:01:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b6899bf5-60f9-486e-8e94-5c2e53e560f3 None None] [instance: 16208bfb-7bef-44b7-bf18-d5ce38e31fa8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:01:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:01:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:02:09 user nova-compute[72929]: INFO nova.compute.claims [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Claim successful on node user
Aug 26 22:02:09 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:02:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.policy [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd44b0a9d8d4f46988219dd36ccb01f93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b52160357a438cbd3b6a5b03e19121', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:02:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Creating image(s)
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "/opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "/opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "/opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk 1073741824" returned: 0 in 0.053s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:02:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Cannot resize image /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Ensure instance console log exists: /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Successfully created port: 31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:12 user nova-compute[72929]: INFO nova.compute.manager [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Rescuing
Aug 26 22:02:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Successfully updated port: 31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-87ae5a23-822a-46be-8f28-f30cc084604d req-aa416fca-1152-4ff1-9ff0-2ea1647a7f4a service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-87ae5a23-822a-46be-8f28-f30cc084604d req-aa416fca-1152-4ff1-9ff0-2ea1647a7f4a service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-87ae5a23-822a-46be-8f28-f30cc084604d req-aa416fca-1152-4ff1-9ff0-2ea1647a7f4a service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-87ae5a23-822a-46be-8f28-f30cc084604d req-aa416fca-1152-4ff1-9ff0-2ea1647a7f4a service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-87ae5a23-822a-46be-8f28-f30cc084604d req-aa416fca-1152-4ff1-9ff0-2ea1647a7f4a service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:13 user nova-compute[72929]: WARNING nova.compute.manager [req-87ae5a23-822a-46be-8f28-f30cc084604d req-aa416fca-1152-4ff1-9ff0-2ea1647a7f4a service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state rescuing.
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquired lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-changed-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Refreshing instance network info cache due to event network-changed-31cd2e68-b957-4024-80b2-43b64534d0d7. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] Acquiring lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance destroyed successfully.
Aug 26 22:02:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Attempting rescue
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72929) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:02:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Creating image(s)
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'trusted_certs' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue" returned: 0 in 0.054s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'migration_context' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.base [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<e17322c4-5841-452d-b4f1-f67f85a9827a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Start _get_guest_xml network_info=[{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:2c:9a:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'resources' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.base [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<e17322c4-5841-452d-b4f1-f67f85a9827a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'numa_topology' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.base [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<e17322c4-5841-452d-b4f1-f67f85a9827a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:02:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'vcpu_model' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.base [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<e17322c4-5841-452d-b4f1-f67f85a9827a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-99622531',display_name='tempest-ServerRescueNegativeTestJSON-server-99622531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-99622531',id=1,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-cdrtnr48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T21:57:47Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=e17322c4-5841-452d-b4f1-f67f85a9827a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:2c:9a:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:2c:9a:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'pci_devices' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.base [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<e17322c4-5841-452d-b4f1-f67f85a9827a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:02:13 user nova-compute[72929]:   <uuid>e17322c4-5841-452d-b4f1-f67f85a9827a</uuid>
Aug 26 22:02:13 user nova-compute[72929]:   <name>instance-00000001</name>
Aug 26 22:02:13 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:02:13 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:02:13 user nova-compute[72929]:   <metadata>
Aug 26 22:02:13 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:02:13 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-99622531</nova:name>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:02:13</nova:creationTime>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:02:13 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:02:13 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:owner>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:user uuid="6c2dac68027a44a09a4deadab28f2981">tempest-ServerRescueNegativeTestJSON-26026282-project-member</nova:user>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:project uuid="4e6d14fc09c246779e46e7c816370a1c">tempest-ServerRescueNegativeTestJSON-26026282</nova:project>
Aug 26 22:02:13 user nova-compute[72929]:       </nova:owner>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:ports>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:port uuid="d4498661-cc5a-4569-8826-1dec471eda12">
Aug 26 22:02:13 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 22:02:13 user nova-compute[72929]:         </nova:port>
Aug 26 22:02:13 user nova-compute[72929]:       </nova:ports>
Aug 26 22:02:13 user nova-compute[72929]:     </nova:instance>
Aug 26 22:02:13 user nova-compute[72929]:   </metadata>
Aug 26 22:02:13 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:02:13 user nova-compute[72929]:     <system>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="serial">e17322c4-5841-452d-b4f1-f67f85a9827a</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="uuid">e17322c4-5841-452d-b4f1-f67f85a9827a</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:02:13 user nova-compute[72929]:     </system>
Aug 26 22:02:13 user nova-compute[72929]:   </sysinfo>
Aug 26 22:02:13 user nova-compute[72929]:   <os>
Aug 26 22:02:13 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:02:13 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:02:13 user nova-compute[72929]:   </os>
Aug 26 22:02:13 user nova-compute[72929]:   <features>
Aug 26 22:02:13 user nova-compute[72929]:     <acpi/>
Aug 26 22:02:13 user nova-compute[72929]:     <apic/>
Aug 26 22:02:13 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:02:13 user nova-compute[72929]:   </features>
Aug 26 22:02:13 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:02:13 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:02:13 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:02:13 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:02:13 user nova-compute[72929]:   </clock>
Aug 26 22:02:13 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:02:13 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:02:13 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:02:13 user nova-compute[72929]:   </cpu>
Aug 26 22:02:13 user nova-compute[72929]:   <devices>
Aug 26 22:02:13 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:02:13 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:02:13 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue"/>
Aug 26 22:02:13 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:     </disk>
Aug 26 22:02:13 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:02:13 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:02:13 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk"/>
Aug 26 22:02:13 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:     </disk>
Aug 26 22:02:13 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:02:13 user nova-compute[72929]:       <mac address="fa:16:3e:2c:9a:a6"/>
Aug 26 22:02:13 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:02:13 user nova-compute[72929]:       <target dev="tapd4498661-cc"/>
Aug 26 22:02:13 user nova-compute[72929]:     </interface>
Aug 26 22:02:13 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:02:13 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/console.log" append="off"/>
Aug 26 22:02:13 user nova-compute[72929]:     </serial>
Aug 26 22:02:13 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:02:13 user nova-compute[72929]:     <video>
Aug 26 22:02:13 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:     </video>
Aug 26 22:02:13 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:02:13 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:02:13 user nova-compute[72929]:     </rng>
Aug 26 22:02:13 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:02:13 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:02:13 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:02:13 user nova-compute[72929]:     </memballoon>
Aug 26 22:02:13 user nova-compute[72929]:   </devices>
Aug 26 22:02:13 user nova-compute[72929]: </domain>
Aug 26 22:02:13 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:02:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance destroyed successfully.
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating instance_info_cache with network_info: [{"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:2c:9a:a6, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Releasing lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Instance network_info: |[{"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] Acquired lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Refreshing network info cache for port 31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Start _get_guest_xml network_info=[{"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:02:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-426322740',display_name='tempest-SnapshotDataIntegrityTests-server-426322740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-426322740',id=15,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBX5AbESjnH3GeEP33a9zvWZiZY37tu/NbrO7/igCqy0oKnuyRFD1BnDcPt2ZnjN/sUlsKbr3Vn2l5yTVQHYg5tvvEV4MRgRSeizqUEYLxX+dypojVNLTbQw4is1ZHoyg==',key_name='tempest-keypair-754946778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b52160357a438cbd3b6a5b03e19121',ramdisk_id='',reservation_id='r-dqqe9b2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1852193928',owner_user_name='tempest-SnapshotDataIntegrityTests-1852193928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44b0a9d8d4f46988219dd36ccb01f93',uuid=3db3d467-df63-4ea0-951b-4eee4460980f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Converting VIF {"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'pci_devices' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:02:13 user nova-compute[72929]:   <uuid>3db3d467-df63-4ea0-951b-4eee4460980f</uuid>
Aug 26 22:02:13 user nova-compute[72929]:   <name>instance-0000000f</name>
Aug 26 22:02:13 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:02:13 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:02:13 user nova-compute[72929]:   <metadata>
Aug 26 22:02:13 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:02:13 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-426322740</nova:name>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:02:13</nova:creationTime>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:02:13 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:02:13 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:owner>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:user uuid="d44b0a9d8d4f46988219dd36ccb01f93">tempest-SnapshotDataIntegrityTests-1852193928-project-member</nova:user>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:project uuid="20b52160357a438cbd3b6a5b03e19121">tempest-SnapshotDataIntegrityTests-1852193928</nova:project>
Aug 26 22:02:13 user nova-compute[72929]:       </nova:owner>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:02:13 user nova-compute[72929]:       <nova:ports>
Aug 26 22:02:13 user nova-compute[72929]:         <nova:port uuid="31cd2e68-b957-4024-80b2-43b64534d0d7">
Aug 26 22:02:13 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:02:13 user nova-compute[72929]:         </nova:port>
Aug 26 22:02:13 user nova-compute[72929]:       </nova:ports>
Aug 26 22:02:13 user nova-compute[72929]:     </nova:instance>
Aug 26 22:02:13 user nova-compute[72929]:   </metadata>
Aug 26 22:02:13 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:02:13 user nova-compute[72929]:     <system>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="serial">3db3d467-df63-4ea0-951b-4eee4460980f</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="uuid">3db3d467-df63-4ea0-951b-4eee4460980f</entry>
Aug 26 22:02:13 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:02:13 user nova-compute[72929]:     </system>
Aug 26 22:02:13 user nova-compute[72929]:   </sysinfo>
Aug 26 22:02:13 user nova-compute[72929]:   <os>
Aug 26 22:02:13 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:02:13 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:02:13 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:02:13 user nova-compute[72929]:   </os>
Aug 26 22:02:13 user nova-compute[72929]:   <features>
Aug 26 22:02:13 user nova-compute[72929]:     <acpi/>
Aug 26 22:02:13 user nova-compute[72929]:     <apic/>
Aug 26 22:02:13 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:02:13 user nova-compute[72929]:   </features>
Aug 26 22:02:13 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:02:13 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:02:13 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:02:13 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:02:13 user nova-compute[72929]:   </clock>
Aug 26 22:02:13 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:02:13 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:02:13 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:02:13 user nova-compute[72929]:   </cpu>
Aug 26 22:02:13 user nova-compute[72929]:   <devices>
Aug 26 22:02:13 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:02:13 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:02:13 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk"/>
Aug 26 22:02:13 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:     </disk>
Aug 26 22:02:13 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:02:13 user nova-compute[72929]:       <mac address="fa:16:3e:d1:91:3e"/>
Aug 26 22:02:13 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:02:13 user nova-compute[72929]:       <target dev="tap31cd2e68-b9"/>
Aug 26 22:02:13 user nova-compute[72929]:     </interface>
Aug 26 22:02:13 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:02:13 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/console.log" append="off"/>
Aug 26 22:02:13 user nova-compute[72929]:     </serial>
Aug 26 22:02:13 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:02:13 user nova-compute[72929]:     <video>
Aug 26 22:02:13 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:02:13 user nova-compute[72929]:     </video>
Aug 26 22:02:13 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:02:13 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:02:13 user nova-compute[72929]:     </rng>
Aug 26 22:02:13 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:02:13 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:02:13 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:02:13 user nova-compute[72929]:     </memballoon>
Aug 26 22:02:13 user nova-compute[72929]:   </devices>
Aug 26 22:02:13 user nova-compute[72929]: </domain>
Aug 26 22:02:13 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-426322740',display_name='tempest-SnapshotDataIntegrityTests-server-426322740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-426322740',id=15,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBX5AbESjnH3GeEP33a9zvWZiZY37tu/NbrO7/igCqy0oKnuyRFD1BnDcPt2ZnjN/sUlsKbr3Vn2l5yTVQHYg5tvvEV4MRgRSeizqUEYLxX+dypojVNLTbQw4is1ZHoyg==',key_name='tempest-keypair-754946778',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b52160357a438cbd3b6a5b03e19121',ramdisk_id='',reservation_id='r-dqqe9b2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1852193928',owner_user_name='tempest-SnapshotDataIntegrityTests-1852193928-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44b0a9d8d4f46988219dd36ccb01f93',uuid=3db3d467-df63-4ea0-951b-4eee4460980f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Converting VIF {"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG os_vif [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31cd2e68-b9, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31cd2e68-b9, col_values=(('external_ids', {'iface-id': '31cd2e68-b957-4024-80b2-43b64534d0d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:91:3e', 'vm-uuid': '3db3d467-df63-4ea0-951b-4eee4460980f'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:13 user nova-compute[72929]: INFO os_vif [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9')
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:02:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No VIF found with MAC fa:16:3e:d1:91:3e, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:02:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updated VIF entry in instance network info cache for port 31cd2e68-b957-4024-80b2-43b64534d0d7. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:02:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating instance_info_cache with network_info: [{"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c143507f-c806-4b4f-8a83-f774506480d4 req-35bb9ef4-650c-4f37-99ec-821d2a7ccc82 service nova] Releasing lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-1c5f2826-a205-4553-a775-d19acec87ba3 req-ea86fc8d-751f-45fe-8803-6b0d5b524756 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1c5f2826-a205-4553-a775-d19acec87ba3 req-ea86fc8d-751f-45fe-8803-6b0d5b524756 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1c5f2826-a205-4553-a775-d19acec87ba3 req-ea86fc8d-751f-45fe-8803-6b0d5b524756 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1c5f2826-a205-4553-a775-d19acec87ba3 req-ea86fc8d-751f-45fe-8803-6b0d5b524756 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-1c5f2826-a205-4553-a775-d19acec87ba3 req-ea86fc8d-751f-45fe-8803-6b0d5b524756 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:15 user nova-compute[72929]: WARNING nova.compute.manager [req-1c5f2826-a205-4553-a775-d19acec87ba3 req-ea86fc8d-751f-45fe-8803-6b0d5b524756 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state rescuing.
Aug 26 22:02:15 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:15 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [{"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-925086ad-8a40-40e1-a537-a00923a0dd3f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.012s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-c1e59538-f701-4a2e-b086-a0b01933c297 req-32a7b127-cf53-4826-951d-276662f4641c service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1e59538-f701-4a2e-b086-a0b01933c297 req-32a7b127-cf53-4826-951d-276662f4641c service nova] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1e59538-f701-4a2e-b086-a0b01933c297 req-32a7b127-cf53-4826-951d-276662f4641c service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1e59538-f701-4a2e-b086-a0b01933c297 req-32a7b127-cf53-4826-951d-276662f4641c service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-c1e59538-f701-4a2e-b086-a0b01933c297 req-32a7b127-cf53-4826-951d-276662f4641c service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] No waiting events found dispatching network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:16 user nova-compute[72929]: WARNING nova.compute.manager [req-c1e59538-f701-4a2e-b086-a0b01933c297 req-32a7b127-cf53-4826-951d-276662f4641c service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received unexpected event network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 for instance with vm_state building and task_state spawning.
Aug 26 22:02:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:17 user nova-compute[72929]: WARNING nova.compute.manager [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state rescuing.
Aug 26 22:02:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:17 user nova-compute[72929]: WARNING nova.compute.manager [req-32b452ef-4465-4665-9d0f-ec3275a441b5 req-07b37fe9-a777-4a33-a6ce-02cb9246c6ec service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state rescuing.
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-675f1f9f-8563-47f5-850e-803851ee029d req-ff95ed48-a3cc-4889-847e-10a5e2c93c93 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-675f1f9f-8563-47f5-850e-803851ee029d req-ff95ed48-a3cc-4889-847e-10a5e2c93c93 service nova] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-675f1f9f-8563-47f5-850e-803851ee029d req-ff95ed48-a3cc-4889-847e-10a5e2c93c93 service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-675f1f9f-8563-47f5-850e-803851ee029d req-ff95ed48-a3cc-4889-847e-10a5e2c93c93 service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-675f1f9f-8563-47f5-850e-803851ee029d req-ff95ed48-a3cc-4889-847e-10a5e2c93c93 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] No waiting events found dispatching network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:18 user nova-compute[72929]: WARNING nova.compute.manager [req-675f1f9f-8563-47f5-850e-803851ee029d req-ff95ed48-a3cc-4889-847e-10a5e2c93c93 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received unexpected event network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 for instance with vm_state building and task_state spawning.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087339.0737975, 3db3d467-df63-4ea0-951b-4eee4460980f => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] VM Resumed (Lifecycle Event)
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Instance spawned successfully.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087339.075969, 3db3d467-df63-4ea0-951b-4eee4460980f => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] VM Started (Lifecycle Event)
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b9fb8010-e567-44b2-a6cf-4b9aaa496455 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for e17322c4-5841-452d-b4f1-f67f85a9827a due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087339.2298768, e17322c4-5841-452d-b4f1-f67f85a9827a => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Resumed (Lifecycle Event)
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Took 9.11 seconds to spawn the instance on the hypervisor.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087339.2332485, e17322c4-5841-452d-b4f1-f67f85a9827a => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Started (Lifecycle Event)
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:19 user nova-compute[72929]: INFO nova.compute.manager [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Took 9.93 seconds to build instance.
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dda9487d-6e38-4d87-b166-fb90b74217ee tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.117s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:22 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:22 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=24.48624038696289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 90e97032-f5f1-412a-b74a-50528262e6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 925086ad-8a40-40e1-a537-a00923a0dd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:02:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:02:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:28 user nova-compute[72929]: INFO nova.compute.manager [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Detaching volume 6de22c4b-9c35-493c-821c-c43c04174ece
Aug 26 22:02:28 user nova-compute[72929]: INFO nova.virt.block_device [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Attempting to driver detach volume 6de22c4b-9c35-493c-821c-c43c04174ece from mountpoint /dev/vdb
Aug 26 22:02:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Attempting to detach device vdb from instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:02:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:02:28 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:02:28 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:02:28 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:02:28 user nova-compute[72929]:   <serial>6de22c4b-9c35-493c-821c-c43c04174ece</serial>
Aug 26 22:02:28 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:02:28 user nova-compute[72929]: </disk>
Aug 26 22:02:28 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:02:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully detached device vdb from instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 from the persistent domain config.
Aug 26 22:02:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:02:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:02:28 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:02:28 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:02:28 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:02:28 user nova-compute[72929]:   <serial>6de22c4b-9c35-493c-821c-c43c04174ece</serial>
Aug 26 22:02:28 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:02:28 user nova-compute[72929]: </disk>
Aug 26 22:02:28 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:02:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087349.0289724, ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:02:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully detached device vdb from instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 from the live domain config.
Aug 26 22:02:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KUHQPVje', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:02:29 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[695ce4fb-1c18-45ca-ab7b-838123294cf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f31868d-fa23-4680-a9be-d2114f0f7f45]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:02:29 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:02:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:02:29 user nova-compute[72929]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece (non-flash)
Aug 26 22:02:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803b3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ee1e2c-1402-4ef6-92aa-6d4450920515]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaea77c-fd2a-41c1-b360-9cd9d91a5589]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f9025b-560c-49ab-8752-6852cfad0e66]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f94d1b4-51ba-4823-b7a0-56df26d9349d]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d055c77-fa5d-4e9c-b53d-0b5c8bfd33f5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16365b1-7746-4a02-bfa5-8643d685f825]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260]
Aug 26 22:02:29 user nova-compute[72929]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece, portal: 172.16.0.220,3260] successful.
Aug 26 22:02:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6de22c4b-9c35-493c-821c-c43c04174ece -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc1140e-2f6d-4f90-b66b-e05a0f359c4f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== disconnect_volume: return (314ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:02:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:02:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-de573b73-a128-4e2e-8c7f-7803f9e27268 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.052s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "c9099ee1-f916-4e61-ae3c-037b12780060" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:02:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:02:33 user nova-compute[72929]: INFO nova.compute.claims [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Claim successful on node user
Aug 26 22:02:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:02:34 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:02:34 user nova-compute[72929]: INFO nova.virt.block_device [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Booting with volume 1daeb1e5-7156-41c1-a393-5be19d5bdd2b at /dev/vda
Aug 26 22:02:34 user nova-compute[72929]: DEBUG os_brick.utils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d4135-7323-45d2-94cb-9634cd145e56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[81104f47-1ccb-4164-b56f-84413b950b8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46ec492-a871-447e-b3c5-09d26f3cbe6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe81495c-bb89-467f-b183-ea1458a2a7af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:02:34 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3217341-550e-45a1-80cb-5b5b37fce55a]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG os_brick.utils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating existing volume attachment record: 811f5076-4801-432e-bbbe-41b051e7fb63 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG nova.policy [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45e307804f7149829c188e99040c5049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e19f8fd7146d45069390beebe8dab168', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:02:35 user nova-compute[72929]: INFO nova.compute.claims [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Claim successful on node user
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:02:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully created port: ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.policy [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8e8fa1fcb0b4fa5aac66bdeee20b647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '675048d1f37047e1bb05a2619fac538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:02:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Creating image(s)
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk 1073741824" returned: 0 in 0.071s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully created port: 4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Successfully created port: 0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Cannot resize image /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Ensure instance console log exists: /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully created port: b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Successfully updated port: 0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquired lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-changed-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Refreshing instance network info cache due to event network-changed-0a501758-13fe-41e5-b210-355d69b6e7b8. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] Acquiring lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully created port: 5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Releasing lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance network_info: |[{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] Acquired lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.network.neutron [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Refreshing network info cache for port 0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start _get_guest_xml network_info=[{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:02:38 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:38 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.objects.instance [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'pci_devices' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:02:38 user nova-compute[72929]:   <uuid>a0172f33-06bb-404d-8fb0-c88927e84bdd</uuid>
Aug 26 22:02:38 user nova-compute[72929]:   <name>instance-00000011</name>
Aug 26 22:02:38 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:02:38 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:02:38 user nova-compute[72929]:   <metadata>
Aug 26 22:02:38 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:02:38 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:02:38 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeTestJSON-server-669557141</nova:name>
Aug 26 22:02:38 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:02:38</nova:creationTime>
Aug 26 22:02:38 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:02:38 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:02:38 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:02:38 user nova-compute[72929]:       <nova:owner>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:user uuid="c8e8fa1fcb0b4fa5aac66bdeee20b647">tempest-AttachVolumeTestJSON-1023625544-project-member</nova:user>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:project uuid="675048d1f37047e1bb05a2619fac538f">tempest-AttachVolumeTestJSON-1023625544</nova:project>
Aug 26 22:02:38 user nova-compute[72929]:       </nova:owner>
Aug 26 22:02:38 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:02:38 user nova-compute[72929]:       <nova:ports>
Aug 26 22:02:38 user nova-compute[72929]:         <nova:port uuid="0a501758-13fe-41e5-b210-355d69b6e7b8">
Aug 26 22:02:38 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:02:38 user nova-compute[72929]:         </nova:port>
Aug 26 22:02:38 user nova-compute[72929]:       </nova:ports>
Aug 26 22:02:38 user nova-compute[72929]:     </nova:instance>
Aug 26 22:02:38 user nova-compute[72929]:   </metadata>
Aug 26 22:02:38 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:02:38 user nova-compute[72929]:     <system>
Aug 26 22:02:38 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:02:38 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:02:38 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:02:38 user nova-compute[72929]:       <entry name="serial">a0172f33-06bb-404d-8fb0-c88927e84bdd</entry>
Aug 26 22:02:38 user nova-compute[72929]:       <entry name="uuid">a0172f33-06bb-404d-8fb0-c88927e84bdd</entry>
Aug 26 22:02:38 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:02:38 user nova-compute[72929]:     </system>
Aug 26 22:02:38 user nova-compute[72929]:   </sysinfo>
Aug 26 22:02:38 user nova-compute[72929]:   <os>
Aug 26 22:02:38 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:02:38 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:02:38 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:02:38 user nova-compute[72929]:   </os>
Aug 26 22:02:38 user nova-compute[72929]:   <features>
Aug 26 22:02:38 user nova-compute[72929]:     <acpi/>
Aug 26 22:02:38 user nova-compute[72929]:     <apic/>
Aug 26 22:02:38 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:02:38 user nova-compute[72929]:   </features>
Aug 26 22:02:38 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:02:38 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:02:38 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:02:38 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:02:38 user nova-compute[72929]:   </clock>
Aug 26 22:02:38 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:02:38 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:02:38 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:02:38 user nova-compute[72929]:   </cpu>
Aug 26 22:02:38 user nova-compute[72929]:   <devices>
Aug 26 22:02:38 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:02:38 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:02:38 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk"/>
Aug 26 22:02:38 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:02:38 user nova-compute[72929]:     </disk>
Aug 26 22:02:38 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:02:38 user nova-compute[72929]:       <mac address="fa:16:3e:e0:4c:2b"/>
Aug 26 22:02:38 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:02:38 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:02:38 user nova-compute[72929]:       <target dev="tap0a501758-13"/>
Aug 26 22:02:38 user nova-compute[72929]:     </interface>
Aug 26 22:02:38 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:02:38 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/console.log" append="off"/>
Aug 26 22:02:38 user nova-compute[72929]:     </serial>
Aug 26 22:02:38 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:02:38 user nova-compute[72929]:     <video>
Aug 26 22:02:38 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:02:38 user nova-compute[72929]:     </video>
Aug 26 22:02:38 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:02:38 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:02:38 user nova-compute[72929]:     </rng>
Aug 26 22:02:38 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:02:38 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:02:38 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:02:38 user nova-compute[72929]:     </memballoon>
Aug 26 22:02:38 user nova-compute[72929]:   </devices>
Aug 26 22:02:38 user nova-compute[72929]: </domain>
Aug 26 22:02:38 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG os_vif [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a501758-13, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a501758-13, col_values=(('external_ids', {'iface-id': '0a501758-13fe-41e5-b210-355d69b6e7b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:4c:2b', 'vm-uuid': 'a0172f33-06bb-404d-8fb0-c88927e84bdd'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:38 user nova-compute[72929]: INFO os_vif [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13')
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:02:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No VIF found with MAC fa:16:3e:e0:4c:2b, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully created port: 8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG nova.network.neutron [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updated VIF entry in instance network info cache for port 0a501758-13fe-41e5-b210-355d69b6e7b8. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG nova.network.neutron [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ff0e6f2f-184c-4741-8873-99decf7e6253 req-41ab771e-a6fe-46b9-bebb-00709233bf74 service nova] Releasing lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-f32a374a-6397-4020-8937-c588d2034159 req-a99885e1-088e-44b0-bda0-f4777b1f1603 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f32a374a-6397-4020-8937-c588d2034159 req-a99885e1-088e-44b0-bda0-f4777b1f1603 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f32a374a-6397-4020-8937-c588d2034159 req-a99885e1-088e-44b0-bda0-f4777b1f1603 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f32a374a-6397-4020-8937-c588d2034159 req-a99885e1-088e-44b0-bda0-f4777b1f1603 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-f32a374a-6397-4020-8937-c588d2034159 req-a99885e1-088e-44b0-bda0-f4777b1f1603 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:40 user nova-compute[72929]: WARNING nova.compute.manager [req-f32a374a-6397-4020-8937-c588d2034159 req-a99885e1-088e-44b0-bda0-f4777b1f1603 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state building and task_state spawning.
Aug 26 22:02:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:40 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087362.172079, a0172f33-06bb-404d-8fb0-c88927e84bdd => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Resumed (Lifecycle Event)
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance spawned successfully.
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087362.179143, a0172f33-06bb-404d-8fb0-c88927e84bdd => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Started (Lifecycle Event)
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:42 user nova-compute[72929]: WARNING nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state building and task_state spawning.
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-ce43e3fe-6244-47f7-a62d-5dcf19718f2e. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-changed-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Refreshing instance network info cache due to event network-changed-8c43ee94-0853-4850-95f1-3f889602ec01. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Refreshing network info cache for port 8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:42 user nova-compute[72929]: INFO nova.compute.manager [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Took 7.40 seconds to build instance.
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a7b32640-eb8d-4397-9ca2-5ff5a5f0b7cc tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.548s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-ba716c16-1cc3-43be-82c6-1aefbb4b546c. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:43 user nova-compute[72929]: DEBUG nova.network.neutron [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3fc5b14b-7f9f-449c-a88d-b85b0b09dea7 req-007d0bd5-a553-4a96-8538-ea7d3950635c service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:43 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-a460343c-e064-4ea3-9fef-306db40e74d2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updated VIF entry in instance network info cache for port 8c43ee94-0853-4850-95f1-3f889602ec01. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ccde9afd-7020-4f0d-9fdb-df1b4bd30360 req-d721af8a-6055-4c5c-8c96-a967b38faed4 service nova] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee9e9c95-b17a-45d4-a669-07a9da2c1375 req-8c305e66-bd54-48ef-a964-c814a1745757 service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: 4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port 4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e90cf9af-7d0d-488c-b4ed-8680088e0730 req-a2df016a-6560-4f9a-8581-66fbd7b993e3 service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:47 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: 5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:48 user nova-compute[72929]: INFO nova.virt.block_device [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Booting with volume ef058ced-a091-4c28-9f4e-2dd6799328c4 at /dev/vdb
Aug 26 22:02:48 user nova-compute[72929]: DEBUG os_brick.utils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb82fb0-89e6-4ecc-b30f-baef78d601ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8418f-1a65-472f-9ba8-e3b9ce4e62c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb3e899-c875-4856-a33f-38f87ddd5c50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2922218-8972-4b62-99e5-ddbae031e83e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:02:48 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b53119f-d880-4a6e-85a3-b9d111bb4785]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG os_brick.utils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating existing volume attachment record: 759afb2f-2f1f-4a83-967b-920c47a2e6df {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-b63a22c2-4938-4dbd-a31d-b1f12749600c. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-5339e07e-21f2-4011-ad90-24450d275c81. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port 5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10d618ac-51c3-4695-b81f-fd573bb87ef1 req-75b7bb89-9ed7-498a-8514-38246c676b6f service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Successfully updated port: 8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:02:49 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:02:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-8bdcacca-0de9-49f7-b11f-03fa3957e7b3. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:02:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:02:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:54 user nova-compute[72929]: INFO nova.compute.manager [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Terminating instance
Aug 26 22:02:54 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-52822b14-5b15-4046-a5d7-5b3bb1f96b1e req-fedbff60-6696-4ad3-b7d1-c4d70e83d305 service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-vif-unplugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-52822b14-5b15-4046-a5d7-5b3bb1f96b1e req-fedbff60-6696-4ad3-b7d1-c4d70e83d305 service nova] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-52822b14-5b15-4046-a5d7-5b3bb1f96b1e req-fedbff60-6696-4ad3-b7d1-c4d70e83d305 service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-52822b14-5b15-4046-a5d7-5b3bb1f96b1e req-fedbff60-6696-4ad3-b7d1-c4d70e83d305 service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-52822b14-5b15-4046-a5d7-5b3bb1f96b1e req-fedbff60-6696-4ad3-b7d1-c4d70e83d305 service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] No waiting events found dispatching network-vif-unplugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-52822b14-5b15-4046-a5d7-5b3bb1f96b1e req-fedbff60-6696-4ad3-b7d1-c4d70e83d305 service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-vif-unplugged-b830140f-6f6c-44f4-b654-5383a95d2f3c for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:02:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Instance destroyed successfully.
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'resources' on Instance uuid c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-635105439',display_name='tempest-VolumesAdminNegativeTest-server-635105439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-635105439',id=13,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b1296783b514e0a93a7d6b8d464335c',ramdisk_id='',reservation_id='r-9bfzec7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1477467048',owner_user_name='tempest-VolumesAdminNegativeTest-1477467048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:55Z,user_data=None,user_id='6509530943dc49dc897e975e0695292f',uuid=c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converting VIF {"id": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "address": "fa:16:3e:a3:75:77", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb830140f-6f", "ovs_interfaceid": "b830140f-6f6c-44f4-b654-5383a95d2f3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG os_vif [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb830140f-6f, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:02:55 user nova-compute[72929]: INFO os_vif [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:75:77,bridge_name='br-int',has_traffic_filtering=True,id=b830140f-6f6c-44f4-b654-5383a95d2f3c,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb830140f-6f')
Aug 26 22:02:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Deleting instance files /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e_del
Aug 26 22:02:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Deletion of /opt/stack/data/nova/instances/c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e_del complete
Aug 26 22:02:55 user nova-compute[72929]: INFO nova.compute.manager [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 22:02:55 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance network_info: |[{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:02:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port 8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:02:56 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:56 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Took 1.04 seconds to deallocate network for instance.
Aug 26 22:02:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] Acquiring lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] No waiting events found dispatching network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:02:57 user nova-compute[72929]: WARNING nova.compute.manager [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received unexpected event network-vif-plugged-b830140f-6f6c-44f4-b654-5383a95d2f3c for instance with vm_state deleted and task_state None.
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-f17df356-05f5-418d-b452-72ec6586328d req-1fc9256f-ddc0-4729-b7d9-80d2c2d7cc6b service nova] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Received event network-vif-deleted-b830140f-6f6c-44f4-b654-5383a95d2f3c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updated VIF entry in instance network info cache for port 8bdcacca-0de9-49f7-b11f-03fa3957e7b3. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0df11e9b-0638-4166-a747-7b816416d48b req-19400fe4-7970-47ad-912d-776c085296e9 service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:57 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Deleted allocations for instance c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e
Aug 26 22:02:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e581f979-0a71-4f3d-ab46-a1acc613f373 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.924s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:02:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:01 user nova-compute[72929]: INFO nova.virt.block_device [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Booting with volume 9ad34fc6-5480-42cc-9f6c-06608b0de9d3 at /dev/vdc
Aug 26 22:03:01 user nova-compute[72929]: DEBUG os_brick.utils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f3896a-a972-4d5d-9318-4fd274d2b67e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8685f1eb-f216-4c12-970a-d4d182bb833d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa6eb82-53b3-4117-8200-e847ed17a108]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b888a13-8165-4416-9e41-ba7fb69ce2a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:03:01 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:03:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f21616-2dc7-4b91-b134-6001a78617db]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG os_brick.utils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:03:01 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating existing volume attachment record: 56ebf0a9-00f7-47fe-ae9c-e9453bde6113 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:03:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:03:07 user nova-compute[72929]: INFO nova.compute.claims [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Claim successful on node user
Aug 26 22:03:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:03:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.policy [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6523950553a47558f00bcad92c2e8b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78cea4ac85b64f0686c0b24380e77511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:03:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Creating image(s)
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "/opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "/opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "/opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk 1073741824" returned: 0 in 0.068s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Successfully created port: a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Cannot resize image /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Ensure instance console log exists: /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Successfully updated port: a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquired lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-changed-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Refreshing instance network info cache due to event network-changed-a0af43a8-699d-42b1-9621-0eb0e934ce29. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] Acquiring lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087375.4304955, c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:10 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] VM Stopped (Lifecycle Event)
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2104bb41-7c6c-41da-aa31-9eabd25e8975 None None] [instance: c0ad1b13-8370-4dbb-a610-0c5c0a77ea0e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updating instance_info_cache with network_info: [{"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Releasing lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Instance network_info: |[{"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] Acquired lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.neutron [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Refreshing network info cache for port a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Start _get_guest_xml network_info=[{"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:03:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-112589346',display_name='tempest-TestVolumeSwap-server-112589346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-112589346',id=18,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXpb9Nczvs7W/DODSdr1DSVqdGeXX8jEg1JoLgtAr2ucEOJ3nMVC5E00WzUTTy1xW/OtfNcEm2xQgQQ8NdngyuqxPmVL5zefMA5Ps8dSVRR0dorZusNe18dS+kGOe7Pig==',key_name='tempest-keypair-1888339583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78cea4ac85b64f0686c0b24380e77511',ramdisk_id='',reservation_id='r-gajabqva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1933790878',owner_user_name='tempest-TestVolumeSwap-1933790878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6523950553a47558f00bcad92c2e8b5',uuid=0babcaa6-ae8f-46bb-b265-67b5fe76cf1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Converting VIF {"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lazy-loading 'pci_devices' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:03:10 user nova-compute[72929]:   <uuid>0babcaa6-ae8f-46bb-b265-67b5fe76cf1a</uuid>
Aug 26 22:03:10 user nova-compute[72929]:   <name>instance-00000012</name>
Aug 26 22:03:10 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:03:10 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:03:10 user nova-compute[72929]:   <metadata>
Aug 26 22:03:10 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:03:10 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:03:10 user nova-compute[72929]:       <nova:name>tempest-TestVolumeSwap-server-112589346</nova:name>
Aug 26 22:03:10 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:03:10</nova:creationTime>
Aug 26 22:03:10 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:03:10 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:03:10 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:03:10 user nova-compute[72929]:       <nova:owner>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:user uuid="f6523950553a47558f00bcad92c2e8b5">tempest-TestVolumeSwap-1933790878-project-member</nova:user>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:project uuid="78cea4ac85b64f0686c0b24380e77511">tempest-TestVolumeSwap-1933790878</nova:project>
Aug 26 22:03:10 user nova-compute[72929]:       </nova:owner>
Aug 26 22:03:10 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:03:10 user nova-compute[72929]:       <nova:ports>
Aug 26 22:03:10 user nova-compute[72929]:         <nova:port uuid="a0af43a8-699d-42b1-9621-0eb0e934ce29">
Aug 26 22:03:10 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:03:10 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:10 user nova-compute[72929]:       </nova:ports>
Aug 26 22:03:10 user nova-compute[72929]:     </nova:instance>
Aug 26 22:03:10 user nova-compute[72929]:   </metadata>
Aug 26 22:03:10 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:03:10 user nova-compute[72929]:     <system>
Aug 26 22:03:10 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:03:10 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:03:10 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:03:10 user nova-compute[72929]:       <entry name="serial">0babcaa6-ae8f-46bb-b265-67b5fe76cf1a</entry>
Aug 26 22:03:10 user nova-compute[72929]:       <entry name="uuid">0babcaa6-ae8f-46bb-b265-67b5fe76cf1a</entry>
Aug 26 22:03:10 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:03:10 user nova-compute[72929]:     </system>
Aug 26 22:03:10 user nova-compute[72929]:   </sysinfo>
Aug 26 22:03:10 user nova-compute[72929]:   <os>
Aug 26 22:03:10 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:03:10 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:03:10 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:03:10 user nova-compute[72929]:   </os>
Aug 26 22:03:10 user nova-compute[72929]:   <features>
Aug 26 22:03:10 user nova-compute[72929]:     <acpi/>
Aug 26 22:03:10 user nova-compute[72929]:     <apic/>
Aug 26 22:03:10 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:03:10 user nova-compute[72929]:   </features>
Aug 26 22:03:10 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:03:10 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:03:10 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:03:10 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:03:10 user nova-compute[72929]:   </clock>
Aug 26 22:03:10 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:03:10 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:03:10 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:03:10 user nova-compute[72929]:   </cpu>
Aug 26 22:03:10 user nova-compute[72929]:   <devices>
Aug 26 22:03:10 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:03:10 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:03:10 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk"/>
Aug 26 22:03:10 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:03:10 user nova-compute[72929]:     </disk>
Aug 26 22:03:10 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:10 user nova-compute[72929]:       <mac address="fa:16:3e:7c:a4:99"/>
Aug 26 22:03:10 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:10 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:10 user nova-compute[72929]:       <target dev="tapa0af43a8-69"/>
Aug 26 22:03:10 user nova-compute[72929]:     </interface>
Aug 26 22:03:10 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:03:10 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/console.log" append="off"/>
Aug 26 22:03:10 user nova-compute[72929]:     </serial>
Aug 26 22:03:10 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:03:10 user nova-compute[72929]:     <video>
Aug 26 22:03:10 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:10 user nova-compute[72929]:     </video>
Aug 26 22:03:10 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:03:10 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:03:10 user nova-compute[72929]:     </rng>
Aug 26 22:03:10 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:03:10 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:03:10 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:03:10 user nova-compute[72929]:     </memballoon>
Aug 26 22:03:10 user nova-compute[72929]:   </devices>
Aug 26 22:03:10 user nova-compute[72929]: </domain>
Aug 26 22:03:10 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-112589346',display_name='tempest-TestVolumeSwap-server-112589346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-112589346',id=18,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXpb9Nczvs7W/DODSdr1DSVqdGeXX8jEg1JoLgtAr2ucEOJ3nMVC5E00WzUTTy1xW/OtfNcEm2xQgQQ8NdngyuqxPmVL5zefMA5Ps8dSVRR0dorZusNe18dS+kGOe7Pig==',key_name='tempest-keypair-1888339583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78cea4ac85b64f0686c0b24380e77511',ramdisk_id='',reservation_id='r-gajabqva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1933790878',owner_user_name='tempest-TestVolumeSwap-1933790878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6523950553a47558f00bcad92c2e8b5',uuid=0babcaa6-ae8f-46bb-b265-67b5fe76cf1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Converting VIF {"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG os_vif [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0af43a8-69, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0af43a8-69, col_values=(('external_ids', {'iface-id': 'a0af43a8-699d-42b1-9621-0eb0e934ce29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:a4:99', 'vm-uuid': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:10 user nova-compute[72929]: INFO os_vif [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69')
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:03:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] No VIF found with MAC fa:16:3e:7c:a4:99, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:03:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updated VIF entry in instance network info cache for port a0af43a8-699d-42b1-9621-0eb0e934ce29. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:03:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updating instance_info_cache with network_info: [{"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-450e6b73-98d5-4eee-a33b-542be7754ebb req-c530140e-6e76-4415-b053-870c68b6d943 service nova] Releasing lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-803bb9ae-5f3d-44c1-aa2f-f60cc02aaba9 req-98dd7498-ee98-44ba-b61d-9f2f5cf0e4a9 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-803bb9ae-5f3d-44c1-aa2f-f60cc02aaba9 req-98dd7498-ee98-44ba-b61d-9f2f5cf0e4a9 service nova] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-803bb9ae-5f3d-44c1-aa2f-f60cc02aaba9 req-98dd7498-ee98-44ba-b61d-9f2f5cf0e4a9 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-803bb9ae-5f3d-44c1-aa2f-f60cc02aaba9 req-98dd7498-ee98-44ba-b61d-9f2f5cf0e4a9 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-803bb9ae-5f3d-44c1-aa2f-f60cc02aaba9 req-98dd7498-ee98-44ba-b61d-9f2f5cf0e4a9 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] No waiting events found dispatching network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:12 user nova-compute[72929]: WARNING nova.compute.manager [req-803bb9ae-5f3d-44c1-aa2f-f60cc02aaba9 req-98dd7498-ee98-44ba-b61d-9f2f5cf0e4a9 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received unexpected event network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 for instance with vm_state building and task_state spawning.
Aug 26 22:03:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:03:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Creating image(s)
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Ensure instance console log exists: /opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Start _get_guest_xml network_info=[{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '811f5076-4801-432e-bbbe-41b051e7fb63', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPcJDVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9099ee1-f916-4e61-ae3c-037b12780060', 'attached_at': '', 'detached_at': '', 'volume_id': '1daeb1e5-7156-41c1-a393-5be19d5bdd2b', 'serial': '1daeb1e5-7156-41c1-a393-5be19d5bdd2b'}, 'boot_index': 0, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '759afb2f-2f1f-4a83-967b-920c47a2e6df', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZzfxSVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9099ee1-f916-4e61-ae3c-037b12780060', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef058ced-a091-4c28-9f4e-2dd6799328c4', 'serial': 'ef058ced-a091-4c28-9f4e-2dd6799328c4'}, 'boot_index': 1, 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '56ebf0a9-00f7-47fe-ae9c-e9453bde6113', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdtXNEUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9099ee1-f916-4e61-ae3c-037b12780060', 'attached_at': '', 'detached_at': '', 'volume_id': '9ad34fc6-5480-42cc-9f6c-06608b0de9d3', 'serial': '9ad34fc6-5480-42cc-9f6c-06608b0de9d3'}, 'boot_index': 2, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:03:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:03:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPcJDVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:03:14 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:14 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:14 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df091c7-7677-4881-91d6-c0d847e17cab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:03:14 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d102b-6345-4481-9d5a-14356c7ab690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b] added
Aug 26 22:03:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dad4ff-cadc-4f1f-a8e4-6728b1757d65]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.101s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba921cd0-60ba-4cdf-a702-bfbd070afd44]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPcJDVWm {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPcJDVWm" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[af200986-fbfd-4a13-9236-b271ae641a0f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPcJDVWm'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[14017c7b-f93b-4fb9-b746-710e19d5f68d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2688dc-32a8-4ab8-b6ac-9abcb3232e85]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0d6a9-3b5a-495f-be9d-5c053986bd92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260]
Aug 26 22:03:14 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260] successful.
Aug 26 22:03:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb57c9a-4c1d-48fb-9198-dc069fdb7a4e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fa47ee-9959-4abb-b8eb-977a41924bc4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:14 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:14 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087394.3658624, 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] VM Resumed (Lifecycle Event)
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Instance spawned successfully.
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb94e47-db16-46c4-83cb-fd60579759ad]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPcJDVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087394.3727849, 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] VM Started (Lifecycle Event)
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Took 5.98 seconds to spawn the instance on the hypervisor.
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-349f7e72-b6d7-4685-927a-b0269c55ba81 req-8b1e8c0b-6bb7-4d02-a0f0-1ef137379da1 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-349f7e72-b6d7-4685-927a-b0269c55ba81 req-8b1e8c0b-6bb7-4d02-a0f0-1ef137379da1 service nova] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-349f7e72-b6d7-4685-927a-b0269c55ba81 req-8b1e8c0b-6bb7-4d02-a0f0-1ef137379da1 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-349f7e72-b6d7-4685-927a-b0269c55ba81 req-8b1e8c0b-6bb7-4d02-a0f0-1ef137379da1 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-349f7e72-b6d7-4685-927a-b0269c55ba81 req-8b1e8c0b-6bb7-4d02-a0f0-1ef137379da1 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] No waiting events found dispatching network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:14 user nova-compute[72929]: WARNING nova.compute.manager [req-349f7e72-b6d7-4685-927a-b0269c55ba81 req-8b1e8c0b-6bb7-4d02-a0f0-1ef137379da1 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received unexpected event network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 for instance with vm_state building and task_state spawning.
Aug 26 22:03:14 user nova-compute[72929]: INFO nova.compute.manager [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Took 6.85 seconds to build instance.
Aug 26 22:03:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1e1b9b0e-1066-4f94-9e61-52d7302656f1 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.956s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '26236646538383964', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236646538383964', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZzfxSVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:03:15 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:15 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:15 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e6fbe-814f-4c63-bed8-e07739d47e3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:03:15 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b985fe-a7ec-4778-9419-46f2f5795d1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4] added
Aug 26 22:03:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705e26f-0894-45de-b79c-7cc74f663d20]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ba2cea-02fe-4ec9-852d-ff541a55722f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZzfxSVQ {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OZzfxSVQ" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[22163f4d-2179-4030-a4d7-c7465021fae9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OZzfxSVQ'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc988af-5acf-4874-a938-3a1688770b87]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9278f51-f09a-41d4-a2d5-506a73502227]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:15 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:15 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f050583a-4aef-42b6-beb4-1bc5e768a50e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260]
Aug 26 22:03:15 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260] successful.
Aug 26 22:03:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[be441f59-dd40-471d-9b52-bc314fa173a2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d522b-7275-4697-a4ae-f7f68f362950]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:15 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:15 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:15 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:15 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945b908-0ad8-44b9-99aa-9920df7ea48f]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:03:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZzfxSVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26363326663663838', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363326663663838', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdtXNEUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:03:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:16 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[860b0d52-227a-4d08-b082-728f7e1081dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:03:16 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[18384d36-5372-4016-bb93-7a8fb98c818b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3] added
Aug 26 22:03:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df661ae-1acf-4b83-82c2-5b6c62376edc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[808f6650-af8f-41ac-8be9-5807ec1e4e46]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdtXNEUP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BdtXNEUP" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f8350-cf07-4f72-af3b-1cd70570f438]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BdtXNEUP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c0673e-149a-4205-9a49-b591b3d8b0e6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6feeda-ab15-4a69-b7ef-d4b9a0eaad8d]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f58888-9d98-4c87-806c-a2b850bf9a7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260]
Aug 26 22:03:17 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260] successful.
Aug 26 22:03:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc2c19-565b-470f-9015-20e427eb65c3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3df704f-7653-49c3-b856-4428fea6be89]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:03:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:17 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:03:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5defe13-cc5a-4649-bc89-746e5ad2c059]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdtXNEUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23537336237366635', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537336237366635', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lazy-loading 'pci_devices' on Instance uuid c9099ee1-f916-4e61-ae3c-037b12780060 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:03:18 user nova-compute[72929]:   <uuid>c9099ee1-f916-4e61-ae3c-037b12780060</uuid>
Aug 26 22:03:18 user nova-compute[72929]:   <name>instance-00000010</name>
Aug 26 22:03:18 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:03:18 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:03:18 user nova-compute[72929]:   <metadata>
Aug 26 22:03:18 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:03:18 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:03:18 user nova-compute[72929]:       <nova:name>tempest-device-tagging-server-1634538895</nova:name>
Aug 26 22:03:18 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:03:13</nova:creationTime>
Aug 26 22:03:18 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:03:18 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:03:18 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:03:18 user nova-compute[72929]:       <nova:owner>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:user uuid="45e307804f7149829c188e99040c5049">tempest-TaggedBootDevicesTest_v242-1916206492-project-member</nova:user>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:project uuid="e19f8fd7146d45069390beebe8dab168">tempest-TaggedBootDevicesTest_v242-1916206492</nova:project>
Aug 26 22:03:18 user nova-compute[72929]:       </nova:owner>
Aug 26 22:03:18 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:03:18 user nova-compute[72929]:       <nova:ports>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="ce43e3fe-6244-47f7-a62d-5dcf19718f2e">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="ba716c16-1cc3-43be-82c6-1aefbb4b546c">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="a460343c-e064-4ea3-9fef-306db40e74d2">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="b63a22c2-4938-4dbd-a31d-b1f12749600c">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.1.1.15" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="5339e07e-21f2-4011-ad90-24450d275c81">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:         <nova:port uuid="8bdcacca-0de9-49f7-b11f-03fa3957e7b3">
Aug 26 22:03:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 26 22:03:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:18 user nova-compute[72929]:       </nova:ports>
Aug 26 22:03:18 user nova-compute[72929]:     </nova:instance>
Aug 26 22:03:18 user nova-compute[72929]:   </metadata>
Aug 26 22:03:18 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:03:18 user nova-compute[72929]:     <system>
Aug 26 22:03:18 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:03:18 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:03:18 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:03:18 user nova-compute[72929]:       <entry name="serial">c9099ee1-f916-4e61-ae3c-037b12780060</entry>
Aug 26 22:03:18 user nova-compute[72929]:       <entry name="uuid">c9099ee1-f916-4e61-ae3c-037b12780060</entry>
Aug 26 22:03:18 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:03:18 user nova-compute[72929]:     </system>
Aug 26 22:03:18 user nova-compute[72929]:   </sysinfo>
Aug 26 22:03:18 user nova-compute[72929]:   <os>
Aug 26 22:03:18 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:03:18 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:03:18 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:03:18 user nova-compute[72929]:   </os>
Aug 26 22:03:18 user nova-compute[72929]:   <features>
Aug 26 22:03:18 user nova-compute[72929]:     <acpi/>
Aug 26 22:03:18 user nova-compute[72929]:     <apic/>
Aug 26 22:03:18 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:03:18 user nova-compute[72929]:   </features>
Aug 26 22:03:18 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:03:18 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:03:18 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:03:18 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:03:18 user nova-compute[72929]:   </clock>
Aug 26 22:03:18 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:03:18 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:03:18 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:03:18 user nova-compute[72929]:   </cpu>
Aug 26 22:03:18 user nova-compute[72929]:   <devices>
Aug 26 22:03:18 user nova-compute[72929]:     <disk type="file" device="cdrom">
Aug 26 22:03:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none"/>
Aug 26 22:03:18 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060/disk.config"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="hda" bus="ide"/>
Aug 26 22:03:18 user nova-compute[72929]:     </disk>
Aug 26 22:03:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:03:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:03:18 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <serial>1daeb1e5-7156-41c1-a393-5be19d5bdd2b</serial>
Aug 26 22:03:18 user nova-compute[72929]:     </disk>
Aug 26 22:03:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:03:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:03:18 user nova-compute[72929]:       <source dev="/dev/sdd"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <serial>ef058ced-a091-4c28-9f4e-2dd6799328c4</serial>
Aug 26 22:03:18 user nova-compute[72929]:     </disk>
Aug 26 22:03:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:03:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:03:18 user nova-compute[72929]:       <source dev="/dev/sde"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="vdc" bus="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <serial>9ad34fc6-5480-42cc-9f6c-06608b0de9d3</serial>
Aug 26 22:03:18 user nova-compute[72929]:     </disk>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:e7:46:aa"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tapce43e3fe-62"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:5d:c1:72"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tapba716c16-1c"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:5a:13:43"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tapa460343c-e0"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:3c:b2:21"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tap4aa5c2be-73"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:98:b0:64"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tapb63a22c2-49"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:2e:f4:f5"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tap5339e07e-21"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:18 user nova-compute[72929]:       <mac address="fa:16:3e:e7:7d:28"/>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:18 user nova-compute[72929]:       <target dev="tap8bdcacca-0d"/>
Aug 26 22:03:18 user nova-compute[72929]:     </interface>
Aug 26 22:03:18 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:03:18 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060/console.log" append="off"/>
Aug 26 22:03:18 user nova-compute[72929]:     </serial>
Aug 26 22:03:18 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:03:18 user nova-compute[72929]:     <video>
Aug 26 22:03:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:18 user nova-compute[72929]:     </video>
Aug 26 22:03:18 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:03:18 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:03:18 user nova-compute[72929]:     </rng>
Aug 26 22:03:18 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:03:18 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:03:18 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:03:18 user nova-compute[72929]:     </memballoon>
Aug 26 22:03:18 user nova-compute[72929]:   </devices>
Aug 26 22:03:18 user nova-compute[72929]: </domain>
Aug 26 22:03:18 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce43e3fe-62, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce43e3fe-62, col_values=(('external_ids', {'iface-id': 'ce43e3fe-6244-47f7-a62d-5dcf19718f2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:46:aa', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62')
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba716c16-1c, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba716c16-1c, col_values=(('external_ids', {'iface-id': 'ba716c16-1cc3-43be-82c6-1aefbb4b546c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:c1:72', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c')
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa460343c-e0, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa460343c-e0, col_values=(('external_ids', {'iface-id': 'a460343c-e064-4ea3-9fef-306db40e74d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:13:43', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0')
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aa5c2be-73, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4aa5c2be-73, col_values=(('external_ids', {'iface-id': '4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:b2:21', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73')
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb63a22c2-49, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb63a22c2-49, col_values=(('external_ids', {'iface-id': 'b63a22c2-4938-4dbd-a31d-b1f12749600c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b0:64', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49')
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:18 user nova-compute[72929]: INFO nova.compute.manager [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Terminating instance
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5339e07e-21, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5339e07e-21, col_values=(('external_ids', {'iface-id': '5339e07e-21f2-4011-ad90-24450d275c81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f4:f5', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21')
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bdcacca-0d, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bdcacca-0d, col_values=(('external_ids', {'iface-id': '8bdcacca-0de9-49f7-b11f-03fa3957e7b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:7d:28', 'vm-uuid': 'c9099ee1-f916-4e61-ae3c-037b12780060'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:19 user nova-compute[72929]: INFO os_vif [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d')
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] No BDM found with device name hda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] No VIF found with MAC fa:16:3e:e7:46:aa, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] No VIF found with MAC fa:16:3e:98:b0:64, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Using config drive
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.compute.manager [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Detaching volume 8ffe740a-3857-4c23-9a0e-6fdec2f374bb
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Creating config drive at /opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060/disk.config
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7fx_jxn8 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.block_device [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Attempting to driver detach volume 8ffe740a-3857-4c23-9a0e-6fdec2f374bb from mountpoint /dev/vdc
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7fx_jxn8" returned: 0 in 0.118s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Instance destroyed successfully.
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'resources' on Instance uuid ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Attempting to detach device vdc from instance 925086ad-8a40-40e1-a537-a00923a0dd3f from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:03:19 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:03:19 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:03:19 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:03:19 user nova-compute[72929]:   <serial>8ffe740a-3857-4c23-9a0e-6fdec2f374bb</serial>
Aug 26 22:03:19 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:03:19 user nova-compute[72929]: </disk>
Aug 26 22:03:19 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1670765526',display_name='tempest-AttachVolumeNegativeTest-server-1670765526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1670765526',id=4,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDedJBuea2/4gQeCDQ92YPRu6qlFW0csdZ0ev5xK1ypfq8x+hSFzfiTW0HnKKlGiVQFj1v0605uzJGN+II14+GfMWSwwmZSsc0AEus8fFLRasmjI9/0GzzUQeqYPWytQjg==',key_name='tempest-keypair-1045925128',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:57:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-h98jjznj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=ef9f239c-6d27-46ed-ba08-bc01a0b4dc51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "address": "fa:16:3e:6c:41:e5", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73b207d0-01", "ovs_interfaceid": "73b207d0-01f3-48c1-b5b1-2e5cd6bc569a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG os_vif [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73b207d0-01, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully detached device vdc from instance 925086ad-8a40-40e1-a537-a00923a0dd3f from the persistent domain config.
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 925086ad-8a40-40e1-a537-a00923a0dd3f from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:03:19 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:03:19 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:03:19 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:03:19 user nova-compute[72929]:   <serial>8ffe740a-3857-4c23-9a0e-6fdec2f374bb</serial>
Aug 26 22:03:19 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:03:19 user nova-compute[72929]: </disk>
Aug 26 22:03:19 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:19 user nova-compute[72929]: INFO os_vif [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:41:e5,bridge_name='br-int',has_traffic_filtering=True,id=73b207d0-01f3-48c1-b5b1-2e5cd6bc569a,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73b207d0-01')
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Deleting instance files /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51_del
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Deletion of /opt/stack/data/nova/instances/ef9f239c-6d27-46ed-ba08-bc01a0b4dc51_del complete
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.254s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-32c05336-76ca-42fb-9930-6fc575426f70 req-5be6c806-4f16-462d-aaec-badbeabca1a2 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-vif-unplugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32c05336-76ca-42fb-9930-6fc575426f70 req-5be6c806-4f16-462d-aaec-badbeabca1a2 service nova] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32c05336-76ca-42fb-9930-6fc575426f70 req-5be6c806-4f16-462d-aaec-badbeabca1a2 service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-32c05336-76ca-42fb-9930-6fc575426f70 req-5be6c806-4f16-462d-aaec-badbeabca1a2 service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-32c05336-76ca-42fb-9930-6fc575426f70 req-5be6c806-4f16-462d-aaec-badbeabca1a2 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] No waiting events found dispatching network-vif-unplugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-32c05336-76ca-42fb-9930-6fc575426f70 req-5be6c806-4f16-462d-aaec-badbeabca1a2 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-vif-unplugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:03:19 user nova-compute[72929]: INFO nova.compute.manager [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 26 22:03:19 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:03:19 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087400.291846, 925086ad-8a40-40e1-a537-a00923a0dd3f => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:03:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully detached device vdc from instance 925086ad-8a40-40e1-a537-a00923a0dd3f from the live domain config.
Aug 26 22:03:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rnCyLzZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:03:20 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c93a4e2-4cbf-4488-8652-f9c757acd45b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3c470a-b0d4-4fe1-aa6c-19cfa5ba0867]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:20 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:20 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:20 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:03:20 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb (non-flash)
Aug 26 22:03:20 user nova-compute[72929]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:03:20 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:03:20 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:03:20 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8056dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb65a2-e810-4387-901e-b8eb87337bf1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bf941b-f1a5-4f27-a2e0-9161696a6978]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[07198cf2-1fc0-4472-92b9-c46a4b0d7ac0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be7589-1480-4e5f-b751-0ba436b20590]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[faca68cb-13d3-4d4a-afc1-92869ede6770]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14fd14-d1dd-4545-97f0-bb0c2990e815]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260]
Aug 26 22:03:20 user nova-compute[72929]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb, portal: 172.16.0.220,3260] successful.
Aug 26 22:03:20 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ffe740a-3857-4c23-9a0e-6fdec2f374bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd146a3f-6e29-46ac-99df-c414b4cf02fc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] <== disconnect_volume: return (356ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:21 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Took 1.32 seconds to deallocate network for instance.
Aug 26 22:03:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-fdeb7243-29bd-4c16-8379-2188db82ba64 req-1eb21ce7-6650-465d-ab47-70baf0558594 service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-vif-deleted-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.objects.instance [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'flavor' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087405.7057664, c9099ee1-f916-4e61-ae3c-037b12780060 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] VM Resumed (Lifecycle Event)
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-1bb15a7f-2d54-4294-af0d-dda3c24372a8 req-5c87d072-7d71-4b0e-9f22-56be6d45391a service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received event network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1bb15a7f-2d54-4294-af0d-dda3c24372a8 req-5c87d072-7d71-4b0e-9f22-56be6d45391a service nova] Acquiring lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1bb15a7f-2d54-4294-af0d-dda3c24372a8 req-5c87d072-7d71-4b0e-9f22-56be6d45391a service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1bb15a7f-2d54-4294-af0d-dda3c24372a8 req-5c87d072-7d71-4b0e-9f22-56be6d45391a service nova] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-1bb15a7f-2d54-4294-af0d-dda3c24372a8 req-5c87d072-7d71-4b0e-9f22-56be6d45391a service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] No waiting events found dispatching network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-1bb15a7f-2d54-4294-af0d-dda3c24372a8 req-5c87d072-7d71-4b0e-9f22-56be6d45391a service nova] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Received unexpected event network-vif-plugged-73b207d0-01f3-48c1-b5b1-2e5cd6bc569a for instance with vm_state deleted and task_state None.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-2154a706-c0e3-4f93-8f30-35f471df2bc1 req-bc08ed67-5d76-4264-a982-cf17af246072 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2154a706-c0e3-4f93-8f30-35f471df2bc1 req-bc08ed67-5d76-4264-a982-cf17af246072 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2154a706-c0e3-4f93-8f30-35f471df2bc1 req-bc08ed67-5d76-4264-a982-cf17af246072 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2154a706-c0e3-4f93-8f30-35f471df2bc1 req-bc08ed67-5d76-4264-a982-cf17af246072 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-2154a706-c0e3-4f93-8f30-35f471df2bc1 req-bc08ed67-5d76-4264-a982-cf17af246072 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-2154a706-c0e3-4f93-8f30-35f471df2bc1 req-bc08ed67-5d76-4264-a982-cf17af246072 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-352fe909-1eac-4438-9b00-2c02df14905a req-892e053e-6df9-439d-89e3-a2bcb627f19b service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-352fe909-1eac-4438-9b00-2c02df14905a req-892e053e-6df9-439d-89e3-a2bcb627f19b service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-352fe909-1eac-4438-9b00-2c02df14905a req-892e053e-6df9-439d-89e3-a2bcb627f19b service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-352fe909-1eac-4438-9b00-2c02df14905a req-892e053e-6df9-439d-89e3-a2bcb627f19b service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-352fe909-1eac-4438-9b00-2c02df14905a req-892e053e-6df9-439d-89e3-a2bcb627f19b service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-352fe909-1eac-4438-9b00-2c02df14905a req-892e053e-6df9-439d-89e3-a2bcb627f19b service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-69e27b18-d077-4ed4-917e-4356b19179b7 req-72062698-b71e-464a-95f0-6af13723e5b5 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-9f879910-9dc8-447b-b4d6-e3587bb32fe7 req-7ea98240-49c0-4fc2-ae6f-d45de59d2584 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-67b3fbb1-2706-43fd-840e-178af9539895 req-fe6d2cc0-73ca-4ea2-b28f-4aa390cb1d9e service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-67b3fbb1-2706-43fd-840e-178af9539895 req-fe6d2cc0-73ca-4ea2-b28f-4aa390cb1d9e service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-67b3fbb1-2706-43fd-840e-178af9539895 req-fe6d2cc0-73ca-4ea2-b28f-4aa390cb1d9e service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-67b3fbb1-2706-43fd-840e-178af9539895 req-fe6d2cc0-73ca-4ea2-b28f-4aa390cb1d9e service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-67b3fbb1-2706-43fd-840e-178af9539895 req-fe6d2cc0-73ca-4ea2-b28f-4aa390cb1d9e service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.compute.manager [req-67b3fbb1-2706-43fd-840e-178af9539895 req-fe6d2cc0-73ca-4ea2-b28f-4aa390cb1d9e service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 for instance with vm_state building and task_state spawning.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:26 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7528MB free_disk=24.440425872802734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a52e218e-17f0-4f9b-9a34-4fb70ccb6458 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.845s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance spawned successfully.
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087405.7075021, c9099ee1-f916-4e61-ae3c-037b12780060 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] VM Started (Lifecycle Event)
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Took 12.62 seconds to spawn the instance on the hypervisor.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.compute.manager [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Took 52.97 seconds to build instance.
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-680c0463-fc01-4782-982a-4e47d8f734f5 tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "c9099ee1-f916-4e61-ae3c-037b12780060" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 53.084s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 5.432s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.482s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:26 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Deleted allocations for instance ef9f239c-6d27-46ed-ba08-bc01a0b4dc51
Aug 26 22:03:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-48c8b39a-0d10-4d45-afe1-2b238fdbb03d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "ef9f239c-6d27-46ed-ba08-bc01a0b4dc51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.073s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 90e97032-f5f1-412a-b74a-50528262e6d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 925086ad-8a40-40e1-a537-a00923a0dd3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c9099ee1-f916-4e61-ae3c-037b12780060 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:03:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.986s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:03:27 user nova-compute[72929]: INFO nova.compute.claims [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Claim successful on node user
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.network.neutron [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:03:27 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.policy [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c6aeec78644486ba130cf6084d76887', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7f712c6e7e418caa20ca971c810660', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:03:27 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Creating image(s)
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.239s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk 1073741824" returned: 0 in 0.065s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Successfully created port: 7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Cannot resize image /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Ensure instance console log exists: /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updating instance_info_cache with network_info: [{"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-90e97032-f5f1-412a-b74a-50528262e6d8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Successfully updated port: 7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-changed-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Refreshing instance network info cache due to event network-changed-7a8d4c8c-2672-4af8-b42e-54be12e2544e. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_power_states {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:03:30 user nova-compute[72929]: WARNING nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid c1608933-05ed-4314-a13b-a48035aa841b {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid c9099ee1-f916-4e61-ae3c-037b12780060 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 8555f690-3843-4989-8d93-2bf3ce87e8ef {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "c1608933-05ed-4314-a13b-a48035aa841b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "c9099ee1-f916-4e61-ae3c-037b12780060" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance network_info: |[{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Refreshing network info cache for port 7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start _get_guest_xml network_info=[{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:03:30 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:30 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'pci_devices' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:03:30 user nova-compute[72929]: WARNING oslo_messaging._drivers.amqpdriver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "c1608933-05ed-4314-a13b-a48035aa841b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "c9099ee1-f916-4e61-ae3c-037b12780060" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.141s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: INFO nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:03:30 user nova-compute[72929]:   <uuid>17b027b1-b249-4fc9-a8f5-43e0cf919525</uuid>
Aug 26 22:03:30 user nova-compute[72929]:   <name>instance-00000013</name>
Aug 26 22:03:30 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:03:30 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:03:30 user nova-compute[72929]:   <metadata>
Aug 26 22:03:30 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:03:30 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:03:30 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherB-server-1992218640</nova:name>
Aug 26 22:03:30 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:03:30</nova:creationTime>
Aug 26 22:03:30 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:03:30 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:03:30 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:03:30 user nova-compute[72929]:       <nova:owner>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:user uuid="9c6aeec78644486ba130cf6084d76887">tempest-ServerActionsTestOtherB-381550606-project-member</nova:user>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:project uuid="2e7f712c6e7e418caa20ca971c810660">tempest-ServerActionsTestOtherB-381550606</nova:project>
Aug 26 22:03:30 user nova-compute[72929]:       </nova:owner>
Aug 26 22:03:30 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:03:30 user nova-compute[72929]:       <nova:ports>
Aug 26 22:03:30 user nova-compute[72929]:         <nova:port uuid="7a8d4c8c-2672-4af8-b42e-54be12e2544e">
Aug 26 22:03:30 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:03:30 user nova-compute[72929]:         </nova:port>
Aug 26 22:03:30 user nova-compute[72929]:       </nova:ports>
Aug 26 22:03:30 user nova-compute[72929]:     </nova:instance>
Aug 26 22:03:30 user nova-compute[72929]:   </metadata>
Aug 26 22:03:30 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:03:30 user nova-compute[72929]:     <system>
Aug 26 22:03:30 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:03:30 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:03:30 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:03:30 user nova-compute[72929]:       <entry name="serial">17b027b1-b249-4fc9-a8f5-43e0cf919525</entry>
Aug 26 22:03:30 user nova-compute[72929]:       <entry name="uuid">17b027b1-b249-4fc9-a8f5-43e0cf919525</entry>
Aug 26 22:03:30 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:03:30 user nova-compute[72929]:     </system>
Aug 26 22:03:30 user nova-compute[72929]:   </sysinfo>
Aug 26 22:03:30 user nova-compute[72929]:   <os>
Aug 26 22:03:30 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:03:30 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:03:30 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:03:30 user nova-compute[72929]:   </os>
Aug 26 22:03:30 user nova-compute[72929]:   <features>
Aug 26 22:03:30 user nova-compute[72929]:     <acpi/>
Aug 26 22:03:30 user nova-compute[72929]:     <apic/>
Aug 26 22:03:30 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:03:30 user nova-compute[72929]:   </features>
Aug 26 22:03:30 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:03:30 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:03:30 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:03:30 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:03:30 user nova-compute[72929]:   </clock>
Aug 26 22:03:30 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:03:30 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:03:30 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:03:30 user nova-compute[72929]:   </cpu>
Aug 26 22:03:30 user nova-compute[72929]:   <devices>
Aug 26 22:03:30 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:03:30 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:03:30 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk"/>
Aug 26 22:03:30 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:03:30 user nova-compute[72929]:     </disk>
Aug 26 22:03:30 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:03:30 user nova-compute[72929]:       <mac address="fa:16:3e:4b:0f:09"/>
Aug 26 22:03:30 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:30 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:03:30 user nova-compute[72929]:       <target dev="tap7a8d4c8c-26"/>
Aug 26 22:03:30 user nova-compute[72929]:     </interface>
Aug 26 22:03:30 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:03:30 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/console.log" append="off"/>
Aug 26 22:03:30 user nova-compute[72929]:     </serial>
Aug 26 22:03:30 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:03:30 user nova-compute[72929]:     <video>
Aug 26 22:03:30 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:03:30 user nova-compute[72929]:     </video>
Aug 26 22:03:30 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:03:30 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:03:30 user nova-compute[72929]:     </rng>
Aug 26 22:03:30 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:03:30 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:03:30 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:03:30 user nova-compute[72929]:     </memballoon>
Aug 26 22:03:30 user nova-compute[72929]:   </devices>
Aug 26 22:03:30 user nova-compute[72929]: </domain>
Aug 26 22:03:30 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG os_vif [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a8d4c8c-26, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a8d4c8c-26, col_values=(('external_ids', {'iface-id': '7a8d4c8c-2672-4af8-b42e-54be12e2544e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0f:09', 'vm-uuid': '17b027b1-b249-4fc9-a8f5-43e0cf919525'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:30 user nova-compute[72929]: INFO os_vif [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26')
Aug 26 22:03:30 user nova-compute[72929]: WARNING nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance is unexpectedly not found. Ignore.
Aug 26 22:03:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.204s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:03:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No VIF found with MAC fa:16:3e:4b:0f:09, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:03:31 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updated VIF entry in instance network info cache for port 7a8d4c8c-2672-4af8-b42e-54be12e2544e. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:03:31 user nova-compute[72929]: DEBUG nova.network.neutron [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c319491-0777-4ef5-af82-ca0bec861009 req-30900866-7bed-4cab-845e-5ad2dd0bd6e2 service nova] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG nova.compute.manager [req-259efe3a-0e01-4b07-839a-9cc2ad1d94d8 req-4f91901e-ef95-437e-85cb-5176e5a17a0b service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-259efe3a-0e01-4b07-839a-9cc2ad1d94d8 req-4f91901e-ef95-437e-85cb-5176e5a17a0b service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-259efe3a-0e01-4b07-839a-9cc2ad1d94d8 req-4f91901e-ef95-437e-85cb-5176e5a17a0b service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-259efe3a-0e01-4b07-839a-9cc2ad1d94d8 req-4f91901e-ef95-437e-85cb-5176e5a17a0b service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG nova.compute.manager [req-259efe3a-0e01-4b07-839a-9cc2ad1d94d8 req-4f91901e-ef95-437e-85cb-5176e5a17a0b service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:32 user nova-compute[72929]: WARNING nova.compute.manager [req-259efe3a-0e01-4b07-839a-9cc2ad1d94d8 req-4f91901e-ef95-437e-85cb-5176e5a17a0b service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state building and task_state spawning.
Aug 26 22:03:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-15cc8851-0ec3-4b1c-af3a-08c4ae065169 req-21d73292-4b72-4561-bfc3-2d87e57dd249 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-15cc8851-0ec3-4b1c-af3a-08c4ae065169 req-21d73292-4b72-4561-bfc3-2d87e57dd249 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-15cc8851-0ec3-4b1c-af3a-08c4ae065169 req-21d73292-4b72-4561-bfc3-2d87e57dd249 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-15cc8851-0ec3-4b1c-af3a-08c4ae065169 req-21d73292-4b72-4561-bfc3-2d87e57dd249 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-15cc8851-0ec3-4b1c-af3a-08c4ae065169 req-21d73292-4b72-4561-bfc3-2d87e57dd249 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:34 user nova-compute[72929]: WARNING nova.compute.manager [req-15cc8851-0ec3-4b1c-af3a-08c4ae065169 req-21d73292-4b72-4561-bfc3-2d87e57dd249 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state building and task_state spawning.
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087399.6071925, ef9f239c-6d27-46ed-ba08-bc01a0b4dc51 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] VM Stopped (Lifecycle Event)
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c01caee7-1530-4550-a04d-2895b341a6f7 None None] [instance: ef9f239c-6d27-46ed-ba08-bc01a0b4dc51] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087414.7044525, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Resumed (Lifecycle Event)
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance spawned successfully.
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087414.707578, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Started (Lifecycle Event)
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Took 6.96 seconds to spawn the instance on the hypervisor.
Aug 26 22:03:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Took 8.79 seconds to build instance.
Aug 26 22:03:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-054dfb7b-3670-41a5-820b-de3b5507ae41 tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.649s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.413s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:34 user nova-compute[72929]: INFO nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:03:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:52 user nova-compute[72929]: INFO nova.compute.manager [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Terminating instance
Aug 26 22:03:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-298cc7eb-6bf3-4b3b-8414-3f31cfa8ef68 req-c61f4216-5f4c-4f28-b750-1e7747d42196 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-vif-unplugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-298cc7eb-6bf3-4b3b-8414-3f31cfa8ef68 req-c61f4216-5f4c-4f28-b750-1e7747d42196 service nova] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-298cc7eb-6bf3-4b3b-8414-3f31cfa8ef68 req-c61f4216-5f4c-4f28-b750-1e7747d42196 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-298cc7eb-6bf3-4b3b-8414-3f31cfa8ef68 req-c61f4216-5f4c-4f28-b750-1e7747d42196 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-298cc7eb-6bf3-4b3b-8414-3f31cfa8ef68 req-c61f4216-5f4c-4f28-b750-1e7747d42196 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] No waiting events found dispatching network-vif-unplugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-298cc7eb-6bf3-4b3b-8414-3f31cfa8ef68 req-c61f4216-5f4c-4f28-b750-1e7747d42196 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-vif-unplugged-6625c989-7fe6-4039-88a7-1d09eb866607 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:03:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Instance destroyed successfully.
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lazy-loading 'resources' on Instance uuid 90e97032-f5f1-412a-b74a-50528262e6d8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-993392427',display_name='tempest-VolumesAdminNegativeTest-server-993392427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-993392427',id=6,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDl+Fha5jyKyHHMzP106FLQHrD0ktTRKjpRKvN9MXtqkrzg/dKQqUWTH2zASQV7T0XX0Co/wUktjyuJeFKrrqUsbS3RLFUWefUa6xf4DEfsXuDrZWwkLDTNn4LpDuHzHww==',key_name='tempest-keypair-1029206930',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b1296783b514e0a93a7d6b8d464335c',ramdisk_id='',reservation_id='r-uvnmumf8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1477467048',owner_user_name='tempest-VolumesAdminNegativeTest-1477467048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:58:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6509530943dc49dc897e975e0695292f',uuid=90e97032-f5f1-412a-b74a-50528262e6d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converting VIF {"id": "6625c989-7fe6-4039-88a7-1d09eb866607", "address": "fa:16:3e:97:68:8b", "network": {"id": "2aebcf79-8dae-4219-8f71-c4412ca88bd7", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-401235979-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b1296783b514e0a93a7d6b8d464335c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6625c989-7f", "ovs_interfaceid": "6625c989-7fe6-4039-88a7-1d09eb866607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG os_vif [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6625c989-7f, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:03:53 user nova-compute[72929]: INFO os_vif [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:68:8b,bridge_name='br-int',has_traffic_filtering=True,id=6625c989-7fe6-4039-88a7-1d09eb866607,network=Network(2aebcf79-8dae-4219-8f71-c4412ca88bd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6625c989-7f')
Aug 26 22:03:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Deleting instance files /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8_del
Aug 26 22:03:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Deletion of /opt/stack/data/nova/instances/90e97032-f5f1-412a-b74a-50528262e6d8_del complete
Aug 26 22:03:53 user nova-compute[72929]: INFO nova.compute.manager [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 26 22:03:53 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:03:53 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:03:54 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:03:54 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Took 0.91 seconds to deallocate network for instance.
Aug 26 22:03:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-4eb7a486-40b4-49a9-bb0a-66adf621a1b3 req-6b482acd-a2c3-4c66-affb-c5d463e903d0 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-vif-deleted-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:54 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:03:54 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:03:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:55 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Deleted allocations for instance 90e97032-f5f1-412a-b74a-50528262e6d8
Aug 26 22:03:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-da647667-3eca-4cb4-a8d7-25a787d3200f req-9cdac955-2200-4c81-b249-e582d3e32852 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received event network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:03:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-da647667-3eca-4cb4-a8d7-25a787d3200f req-9cdac955-2200-4c81-b249-e582d3e32852 service nova] Acquiring lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:03:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-da647667-3eca-4cb4-a8d7-25a787d3200f req-9cdac955-2200-4c81-b249-e582d3e32852 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:03:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-da647667-3eca-4cb4-a8d7-25a787d3200f req-9cdac955-2200-4c81-b249-e582d3e32852 service nova] Lock "90e97032-f5f1-412a-b74a-50528262e6d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-da647667-3eca-4cb4-a8d7-25a787d3200f req-9cdac955-2200-4c81-b249-e582d3e32852 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] No waiting events found dispatching network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:03:55 user nova-compute[72929]: WARNING nova.compute.manager [req-da647667-3eca-4cb4-a8d7-25a787d3200f req-9cdac955-2200-4c81-b249-e582d3e32852 service nova] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Received unexpected event network-vif-plugged-6625c989-7fe6-4039-88a7-1d09eb866607 for instance with vm_state deleted and task_state None.
Aug 26 22:03:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-369f2de6-d9bd-44a3-baec-1f6b559b9c04 tempest-VolumesAdminNegativeTest-1477467048 tempest-VolumesAdminNegativeTest-1477467048-project-member] Lock "90e97032-f5f1-412a-b74a-50528262e6d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:03:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:03:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-changed-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Refreshing instance network info cache due to event network-changed-31cd2e68-b957-4024-80b2-43b64534d0d7. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] Acquiring lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] Acquired lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Refreshing network info cache for port 31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updated VIF entry in instance network info cache for port 31cd2e68-b957-4024-80b2-43b64534d0d7. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating instance_info_cache with network_info: [{"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6d229a00-2b6b-4287-8c44-8db105fb24c1 req-367067b6-a348-4e0e-9adf-10e8cf1d5091 service nova] Releasing lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:03 user nova-compute[72929]: INFO nova.compute.manager [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Unrescuing
Aug 26 22:04:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'flavor' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-220ce5d4-de70-4553-a8a3-c252a66ca611 req-6d65a84b-c9ed-46c7-919a-36187cac6007 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-220ce5d4-de70-4553-a8a3-c252a66ca611 req-6d65a84b-c9ed-46c7-919a-36187cac6007 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-220ce5d4-de70-4553-a8a3-c252a66ca611 req-6d65a84b-c9ed-46c7-919a-36187cac6007 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-220ce5d4-de70-4553-a8a3-c252a66ca611 req-6d65a84b-c9ed-46c7-919a-36187cac6007 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-220ce5d4-de70-4553-a8a3-c252a66ca611 req-6d65a84b-c9ed-46c7-919a-36187cac6007 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:04 user nova-compute[72929]: WARNING nova.compute.manager [req-220ce5d4-de70-4553-a8a3-c252a66ca611 req-6d65a84b-c9ed-46c7-919a-36187cac6007 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:04:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:04 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance destroyed successfully.
Aug 26 22:04:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:06 user nova-compute[72929]: INFO nova.compute.manager [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attaching volume c5d35e33-b6ef-40dd-96be-50425b6e8946 to /dev/vdb
Aug 26 22:04:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:06 user nova-compute[72929]: WARNING nova.compute.manager [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:04:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:06 user nova-compute[72929]: WARNING nova.compute.manager [req-ee5933f5-c9fc-4d38-ab46-35ea863d2ba2 req-b4481618-287f-4a03-8f8b-be33fb565cd6 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:04:06 user nova-compute[72929]: DEBUG os_brick.utils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd6b52-56e8-4351-b3ca-3a143a491277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8227276-c1bc-4c61-ab42-86540594ba56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e192d-4591-492e-8b99-fed77353bae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[68475a49-3f1f-43ec-b134-6bf0ab0a936d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:04:06 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:04:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdb7ec4-41f4-4ddd-aa76-21864723db90]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG os_brick.utils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:04:06 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating existing volume attachment record: c9344bdb-9963-4676-be99-96fb84ee8535 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:04:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for e17322c4-5841-452d-b4f1-f67f85a9827a due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087448.3518865, e17322c4-5841-452d-b4f1-f67f85a9827a => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Resumed (Lifecycle Event)
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7b2948fd-5ded-47bd-a94b-9ddfbaafae14 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:04:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087448.359135, e17322c4-5841-452d-b4f1-f67f85a9827a => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Started (Lifecycle Event)
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087433.4941356, 90e97032-f5f1-412a-b74a-50528262e6d8 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:08 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] VM Stopped (Lifecycle Event)
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5d7cb209-253b-4a5b-87fe-adb4bea14f0b None None] [instance: 90e97032-f5f1-412a-b74a-50528262e6d8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d8d9933-2a92-4c59-a20e-bfb291f012fa req-5a19e43e-7605-45cc-b559-2a1daed9afc4 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d8d9933-2a92-4c59-a20e-bfb291f012fa req-5a19e43e-7605-45cc-b559-2a1daed9afc4 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d8d9933-2a92-4c59-a20e-bfb291f012fa req-5a19e43e-7605-45cc-b559-2a1daed9afc4 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d8d9933-2a92-4c59-a20e-bfb291f012fa req-5a19e43e-7605-45cc-b559-2a1daed9afc4 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d8d9933-2a92-4c59-a20e-bfb291f012fa req-5a19e43e-7605-45cc-b559-2a1daed9afc4 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:08 user nova-compute[72929]: WARNING nova.compute.manager [req-2d8d9933-2a92-4c59-a20e-bfb291f012fa req-5a19e43e-7605-45cc-b559-2a1daed9afc4 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state active and task_state None.
Aug 26 22:04:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:09 user nova-compute[72929]: INFO nova.compute.manager [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Terminating instance
Aug 26 22:04:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Instance destroyed successfully.
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'resources' on Instance uuid 925086ad-8a40-40e1-a537-a00923a0dd3f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:57:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-584320566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-584320566',id=5,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRFaPTVM4OFRu1DthBEJTVU2EIFqlrkWnEW06IquF3BgEMnN3jf16w1C+hlgxb4vW3PW0MZWYJRsFdtZHXX3UIpkEai0Zlf+C0WaylyFHaJFyimjpZ4ei+spTEGUz+6FQ==',key_name='tempest-keypair-144813694',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:01:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-6z0hzvy2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:01:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=925086ad-8a40-40e1-a537-a00923a0dd3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "b33f29b7-cf46-4503-ab4e-b067767186ed", "address": "fa:16:3e:83:35:e9", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb33f29b7-cf", "ovs_interfaceid": "b33f29b7-cf46-4503-ab4e-b067767186ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG os_vif [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb33f29b7-cf, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:04:10 user nova-compute[72929]: INFO os_vif [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:35:e9,bridge_name='br-int',has_traffic_filtering=True,id=b33f29b7-cf46-4503-ab4e-b067767186ed,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb33f29b7-cf')
Aug 26 22:04:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Deleting instance files /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f_del
Aug 26 22:04:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Deletion of /opt/stack/data/nova/instances/925086ad-8a40-40e1-a537-a00923a0dd3f_del complete
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-304d49f5-9c72-42ed-abaf-42c6964a8396 req-1bd1f77d-6550-4d64-ade2-5c77ae590f7a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-304d49f5-9c72-42ed-abaf-42c6964a8396 req-1bd1f77d-6550-4d64-ade2-5c77ae590f7a service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-304d49f5-9c72-42ed-abaf-42c6964a8396 req-1bd1f77d-6550-4d64-ade2-5c77ae590f7a service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-304d49f5-9c72-42ed-abaf-42c6964a8396 req-1bd1f77d-6550-4d64-ade2-5c77ae590f7a service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-304d49f5-9c72-42ed-abaf-42c6964a8396 req-1bd1f77d-6550-4d64-ade2-5c77ae590f7a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-304d49f5-9c72-42ed-abaf-42c6964a8396 req-1bd1f77d-6550-4d64-ade2-5c77ae590f7a service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:10 user nova-compute[72929]: INFO nova.compute.manager [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 22:04:10 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:04:10 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:04:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:12 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Took 1.66 seconds to deallocate network for instance.
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-badbe675-1c51-4bb3-b931-a07c5dc6f576 req-49657ccd-6b65-401d-b38d-dd45fd523fcb service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-deleted-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:12 user nova-compute[72929]: WARNING nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state deleted and task_state None.
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:12 user nova-compute[72929]: WARNING nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state deleted and task_state None.
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:12 user nova-compute[72929]: WARNING nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state deleted and task_state None.
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:12 user nova-compute[72929]: WARNING nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-unplugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state deleted and task_state None.
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Acquiring lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] No waiting events found dispatching network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:12 user nova-compute[72929]: WARNING nova.compute.manager [req-ede566bc-a306-4537-b5bf-46134a3ad4be req-90ae3f8b-2027-46a5-bd63-b26b2d62a62b service nova] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Received unexpected event network-vif-plugged-b33f29b7-cf46-4503-ab4e-b067767186ed for instance with vm_state deleted and task_state None.
Aug 26 22:04:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:12 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Deleted allocations for instance 925086ad-8a40-40e1-a537-a00923a0dd3f
Aug 26 22:04:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-54f21b15-9420-4313-b349-727bc0d57045 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "925086ad-8a40-40e1-a537-a00923a0dd3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.294s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:04:14 user nova-compute[72929]: INFO nova.compute.claims [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Claim successful on node user
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:04:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.policy [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ef1bea627245e29428b442787db7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a593fe9fb7a442f08880ecd2fab42df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:04:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Creating image(s)
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "/opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk 1073741824" returned: 0 in 0.071s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Successfully created port: 99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Cannot resize image /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Ensure instance console log exists: /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Successfully updated port: 99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquired lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received event network-changed-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Refreshing instance network info cache due to event network-changed-99b17457-c0da-41f5-a632-9aeffe501810. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] Acquiring lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updating instance_info_cache with network_info: [{"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Releasing lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Instance network_info: |[{"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] Acquired lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Refreshing network info cache for port 99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Start _get_guest_xml network_info=[{"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:04:17 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:04:17 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-231720761',display_name='tempest-AttachVolumeNegativeTest-server-231720761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-231720761',id=20,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEuCgs8dAPbDab71TTdu0JVo8oZOy6wlQsPtEBNj/MtMTJnLZ0HqmIjdZl6+wiSBtB4jl46F6RiN5il7GaN2Qpj3BKFYxUZAVtnjiN8zOMjid5W7RsT2NReJOeCKi76Ng==',key_name='tempest-keypair-327929541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-5rp8rfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=63d06f04-417d-4f92-bf7c-d4809e518d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'pci_devices' on Instance uuid 63d06f04-417d-4f92-bf7c-d4809e518d2a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:04:17 user nova-compute[72929]:   <uuid>63d06f04-417d-4f92-bf7c-d4809e518d2a</uuid>
Aug 26 22:04:17 user nova-compute[72929]:   <name>instance-00000014</name>
Aug 26 22:04:17 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:04:17 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:04:17 user nova-compute[72929]:   <metadata>
Aug 26 22:04:17 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:04:17 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:04:17 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeNegativeTest-server-231720761</nova:name>
Aug 26 22:04:17 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:04:17</nova:creationTime>
Aug 26 22:04:17 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:04:17 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:04:17 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:04:17 user nova-compute[72929]:       <nova:owner>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:user uuid="64ef1bea627245e29428b442787db7b7">tempest-AttachVolumeNegativeTest-600362177-project-member</nova:user>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:project uuid="a593fe9fb7a442f08880ecd2fab42df6">tempest-AttachVolumeNegativeTest-600362177</nova:project>
Aug 26 22:04:17 user nova-compute[72929]:       </nova:owner>
Aug 26 22:04:17 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:04:17 user nova-compute[72929]:       <nova:ports>
Aug 26 22:04:17 user nova-compute[72929]:         <nova:port uuid="99b17457-c0da-41f5-a632-9aeffe501810">
Aug 26 22:04:17 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 22:04:17 user nova-compute[72929]:         </nova:port>
Aug 26 22:04:17 user nova-compute[72929]:       </nova:ports>
Aug 26 22:04:17 user nova-compute[72929]:     </nova:instance>
Aug 26 22:04:17 user nova-compute[72929]:   </metadata>
Aug 26 22:04:17 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:04:17 user nova-compute[72929]:     <system>
Aug 26 22:04:17 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:04:17 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:04:17 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:04:17 user nova-compute[72929]:       <entry name="serial">63d06f04-417d-4f92-bf7c-d4809e518d2a</entry>
Aug 26 22:04:17 user nova-compute[72929]:       <entry name="uuid">63d06f04-417d-4f92-bf7c-d4809e518d2a</entry>
Aug 26 22:04:17 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:04:17 user nova-compute[72929]:     </system>
Aug 26 22:04:17 user nova-compute[72929]:   </sysinfo>
Aug 26 22:04:17 user nova-compute[72929]:   <os>
Aug 26 22:04:17 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:04:17 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:04:17 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:04:17 user nova-compute[72929]:   </os>
Aug 26 22:04:17 user nova-compute[72929]:   <features>
Aug 26 22:04:17 user nova-compute[72929]:     <acpi/>
Aug 26 22:04:17 user nova-compute[72929]:     <apic/>
Aug 26 22:04:17 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:04:17 user nova-compute[72929]:   </features>
Aug 26 22:04:17 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:04:17 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:04:17 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:04:17 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:04:17 user nova-compute[72929]:   </clock>
Aug 26 22:04:17 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:04:17 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:04:17 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:04:17 user nova-compute[72929]:   </cpu>
Aug 26 22:04:17 user nova-compute[72929]:   <devices>
Aug 26 22:04:17 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:04:17 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:04:17 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk"/>
Aug 26 22:04:17 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:04:17 user nova-compute[72929]:     </disk>
Aug 26 22:04:17 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:04:17 user nova-compute[72929]:       <mac address="fa:16:3e:b7:46:0a"/>
Aug 26 22:04:17 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:04:17 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:04:17 user nova-compute[72929]:       <target dev="tap99b17457-c0"/>
Aug 26 22:04:17 user nova-compute[72929]:     </interface>
Aug 26 22:04:17 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:04:17 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/console.log" append="off"/>
Aug 26 22:04:17 user nova-compute[72929]:     </serial>
Aug 26 22:04:17 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:04:17 user nova-compute[72929]:     <video>
Aug 26 22:04:17 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:04:17 user nova-compute[72929]:     </video>
Aug 26 22:04:17 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:04:17 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:04:17 user nova-compute[72929]:     </rng>
Aug 26 22:04:17 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:04:17 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:04:17 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:04:17 user nova-compute[72929]:     </memballoon>
Aug 26 22:04:17 user nova-compute[72929]:   </devices>
Aug 26 22:04:17 user nova-compute[72929]: </domain>
Aug 26 22:04:17 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-231720761',display_name='tempest-AttachVolumeNegativeTest-server-231720761',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-231720761',id=20,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEuCgs8dAPbDab71TTdu0JVo8oZOy6wlQsPtEBNj/MtMTJnLZ0HqmIjdZl6+wiSBtB4jl46F6RiN5il7GaN2Qpj3BKFYxUZAVtnjiN8zOMjid5W7RsT2NReJOeCKi76Ng==',key_name='tempest-keypair-327929541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-5rp8rfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:04:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=63d06f04-417d-4f92-bf7c-d4809e518d2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG os_vif [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99b17457-c0, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99b17457-c0, col_values=(('external_ids', {'iface-id': '99b17457-c0da-41f5-a632-9aeffe501810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:46:0a', 'vm-uuid': '63d06f04-417d-4f92-bf7c-d4809e518d2a'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:17 user nova-compute[72929]: INFO os_vif [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0')
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:b7:46:0a, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updated VIF entry in instance network info cache for port 99b17457-c0da-41f5-a632-9aeffe501810. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updating instance_info_cache with network_info: [{"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c66607f-daa7-4e86-9548-5a5796cdc150 req-1779b434-fab1-4698-92d0-192c654f4b62 service nova] Releasing lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWflduKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:04:18 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:04:18 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:04:18 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90d766-9a6d-44c3-813b-e91256828373]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:04:18 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a5cfcf-b6f8-448c-9d82-fcdbfa5f13dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946] added
Aug 26 22:04:18 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48957db-ebf1-4d02-a6f8-d021814a6536]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f87a7d-c3f2-4f52-b7c2-dceac44e9856]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWflduKn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hWflduKn" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02ea1a5-f82c-4e60-9238-0632c9657bf8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hWflduKn'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6162708e-1c1b-48f9-8072-c617b33507e6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-da0cf273-526b-4e66-9c76-41971f0f40be req-efd636ad-77ab-4cd2-99ac-76bceea53533 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received event network-vif-plugged-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-da0cf273-526b-4e66-9c76-41971f0f40be req-efd636ad-77ab-4cd2-99ac-76bceea53533 service nova] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-da0cf273-526b-4e66-9c76-41971f0f40be req-efd636ad-77ab-4cd2-99ac-76bceea53533 service nova] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-da0cf273-526b-4e66-9c76-41971f0f40be req-efd636ad-77ab-4cd2-99ac-76bceea53533 service nova] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-da0cf273-526b-4e66-9c76-41971f0f40be req-efd636ad-77ab-4cd2-99ac-76bceea53533 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] No waiting events found dispatching network-vif-plugged-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:19 user nova-compute[72929]: WARNING nova.compute.manager [req-da0cf273-526b-4e66-9c76-41971f0f40be req-efd636ad-77ab-4cd2-99ac-76bceea53533 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received unexpected event network-vif-plugged-99b17457-c0da-41f5-a632-9aeffe501810 for instance with vm_state building and task_state spawning.
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3616695-5cee-459c-b1b9-b277607cd994]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2effed3a-c7e6-4f27-b027-b2f635591bd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260]
Aug 26 22:04:19 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260] successful.
Aug 26 22:04:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3725856-de0d-4305-b537-125d2d398f43]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e10478-60a5-4f08-af72-beb525a61307]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:04:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.050s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[56768879-d54b-4120-98f0-dae0894872dc]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWflduKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.530s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== connect_volume: return (1532ms) {'type': 'block', 'scsi_wwn': '26532366333316534', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532366333316534', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:04:20 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:04:20 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:04:20 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:04:20 user nova-compute[72929]:   <serial>c5d35e33-b6ef-40dd-96be-50425b6e8946</serial>
Aug 26 22:04:20 user nova-compute[72929]: </disk>
Aug 26 22:04:20 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No VIF found with MAC fa:16:3e:d1:91:3e, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7af01e75-2111-4206-84b5-81e2eff6604a tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.598s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087461.056218, 63d06f04-417d-4f92-bf7c-d4809e518d2a => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] VM Resumed (Lifecycle Event)
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Instance spawned successfully.
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-960df8ab-d01c-4966-b10c-9c1a3bb1fdcf req-1fac76fb-aa56-45ab-9023-853a853107b8 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received event network-vif-plugged-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-960df8ab-d01c-4966-b10c-9c1a3bb1fdcf req-1fac76fb-aa56-45ab-9023-853a853107b8 service nova] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-960df8ab-d01c-4966-b10c-9c1a3bb1fdcf req-1fac76fb-aa56-45ab-9023-853a853107b8 service nova] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-960df8ab-d01c-4966-b10c-9c1a3bb1fdcf req-1fac76fb-aa56-45ab-9023-853a853107b8 service nova] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-960df8ab-d01c-4966-b10c-9c1a3bb1fdcf req-1fac76fb-aa56-45ab-9023-853a853107b8 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] No waiting events found dispatching network-vif-plugged-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:21 user nova-compute[72929]: WARNING nova.compute.manager [req-960df8ab-d01c-4966-b10c-9c1a3bb1fdcf req-1fac76fb-aa56-45ab-9023-853a853107b8 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received unexpected event network-vif-plugged-99b17457-c0da-41f5-a632-9aeffe501810 for instance with vm_state building and task_state spawning.
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087461.0670917, 63d06f04-417d-4f92-bf7c-d4809e518d2a => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] VM Started (Lifecycle Event)
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:04:21 user nova-compute[72929]: INFO nova.compute.manager [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Took 7.05 seconds to build instance.
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85166774-fba1-40f5-a252-4f91086695bc tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.149s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:04:24 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:04:24 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:04:24 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7413MB free_disk=24.462566375732422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c9099ee1-f916-4e61-ae3c-037b12780060 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 63d06f04-417d-4f92-bf7c-d4809e518d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087450.5324466, 925086ad-8a40-40e1-a537-a00923a0dd3f => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:25 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] VM Stopped (Lifecycle Event)
Aug 26 22:04:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-181fbed6-42b1-4570-8d3b-298948df4a48 None None] [instance: 925086ad-8a40-40e1-a537-a00923a0dd3f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-changed-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Refreshing instance network info cache due to event network-changed-0a501758-13fe-41e5-b210-355d69b6e7b8. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] Acquiring lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] Acquired lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Refreshing network info cache for port 0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updated VIF entry in instance network info cache for port 0a501758-13fe-41e5-b210-355d69b6e7b8. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c3f869e-7374-4af4-89b8-0b0c29f98120 req-638990b0-1a60-488a-8e9e-29077f8776ae service nova] Releasing lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:04:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:31 user nova-compute[72929]: INFO nova.compute.manager [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Attaching volume 16a42b1a-1527-46b4-9e96-3c16f6c0c981 to /dev/vdb
Aug 26 22:04:31 user nova-compute[72929]: DEBUG os_brick.utils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab9af99-2b6e-4244-b0ae-6df88b3d10c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a463bb-6f1e-467d-a396-9907cdde5422]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f5f90-8156-4d20-a163-2e1444855451]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78bdb5-0397-4287-9ae8-3fc439db8194]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:04:32 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:04:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e34f5-70e5-40f5-a47d-c260d3f9c019]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG os_brick.utils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating existing volume attachment record: 007a6edf-d43d-43cf-b897-1e0e4fefa67b {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:37 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:04:37 user nova-compute[72929]: INFO nova.compute.claims [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Claim successful on node user
Aug 26 22:04:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:04:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.policy [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93c597a2c99646f1bb79645380ce0b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6cde0e448142e48abb9220470391f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:04:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Creating image(s)
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.201s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk 1073741824" returned: 0 in 0.060s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Successfully created port: b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Cannot resize image /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Ensure instance console log exists: /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Successfully updated port: b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquired lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-changed-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Refreshing instance network info cache due to event network-changed-b77cb74f-4900-4123-9977-e70738850ef2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] Acquiring lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updating instance_info_cache with network_info: [{"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Releasing lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance network_info: |[{"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] Acquired lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.neutron [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Refreshing network info cache for port b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Start _get_guest_xml network_info=[{"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:04:40 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:04:40 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-979185243',display_name='tempest-tempest.common.compute-instance-979185243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-979185243',id=21,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDr7ycWbe4a18QCutvpkP7CWIG7sFeN9yLq+Fk/+9la9FZ2+WrmjN1SrIaq9M5vapNsgXhY/fqJ+zVC2xw49y0ephiZ/bKzdZoGG4k3f4lcfIHaaq0HpH7+wgK2/e4Lsg==',key_name='tempest-keypair-1072437854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-8pqov304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=ca93842d-f13f-4b73-8e2e-06da55cdc8bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'pci_devices' on Instance uuid ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:04:40 user nova-compute[72929]:   <uuid>ca93842d-f13f-4b73-8e2e-06da55cdc8bc</uuid>
Aug 26 22:04:40 user nova-compute[72929]:   <name>instance-00000015</name>
Aug 26 22:04:40 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:04:40 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:04:40 user nova-compute[72929]:   <metadata>
Aug 26 22:04:40 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:04:40 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:04:40 user nova-compute[72929]:       <nova:name>tempest-tempest.common.compute-instance-979185243</nova:name>
Aug 26 22:04:40 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:04:40</nova:creationTime>
Aug 26 22:04:40 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:04:40 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:04:40 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:04:40 user nova-compute[72929]:       <nova:owner>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:user uuid="93c597a2c99646f1bb79645380ce0b75">tempest-ServerActionsTestOtherA-1951554093-project-member</nova:user>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:project uuid="4e6cde0e448142e48abb9220470391f2">tempest-ServerActionsTestOtherA-1951554093</nova:project>
Aug 26 22:04:40 user nova-compute[72929]:       </nova:owner>
Aug 26 22:04:40 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:04:40 user nova-compute[72929]:       <nova:ports>
Aug 26 22:04:40 user nova-compute[72929]:         <nova:port uuid="b77cb74f-4900-4123-9977-e70738850ef2">
Aug 26 22:04:40 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 22:04:40 user nova-compute[72929]:         </nova:port>
Aug 26 22:04:40 user nova-compute[72929]:       </nova:ports>
Aug 26 22:04:40 user nova-compute[72929]:     </nova:instance>
Aug 26 22:04:40 user nova-compute[72929]:   </metadata>
Aug 26 22:04:40 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:04:40 user nova-compute[72929]:     <system>
Aug 26 22:04:40 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:04:40 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:04:40 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:04:40 user nova-compute[72929]:       <entry name="serial">ca93842d-f13f-4b73-8e2e-06da55cdc8bc</entry>
Aug 26 22:04:40 user nova-compute[72929]:       <entry name="uuid">ca93842d-f13f-4b73-8e2e-06da55cdc8bc</entry>
Aug 26 22:04:40 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:04:40 user nova-compute[72929]:     </system>
Aug 26 22:04:40 user nova-compute[72929]:   </sysinfo>
Aug 26 22:04:40 user nova-compute[72929]:   <os>
Aug 26 22:04:40 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:04:40 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:04:40 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:04:40 user nova-compute[72929]:   </os>
Aug 26 22:04:40 user nova-compute[72929]:   <features>
Aug 26 22:04:40 user nova-compute[72929]:     <acpi/>
Aug 26 22:04:40 user nova-compute[72929]:     <apic/>
Aug 26 22:04:40 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:04:40 user nova-compute[72929]:   </features>
Aug 26 22:04:40 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:04:40 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:04:40 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:04:40 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:04:40 user nova-compute[72929]:   </clock>
Aug 26 22:04:40 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:04:40 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:04:40 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:04:40 user nova-compute[72929]:   </cpu>
Aug 26 22:04:40 user nova-compute[72929]:   <devices>
Aug 26 22:04:40 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:04:40 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:04:40 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk"/>
Aug 26 22:04:40 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:04:40 user nova-compute[72929]:     </disk>
Aug 26 22:04:40 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:04:40 user nova-compute[72929]:       <mac address="fa:16:3e:d4:08:ee"/>
Aug 26 22:04:40 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:04:40 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:04:40 user nova-compute[72929]:       <target dev="tapb77cb74f-49"/>
Aug 26 22:04:40 user nova-compute[72929]:     </interface>
Aug 26 22:04:40 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:04:40 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/console.log" append="off"/>
Aug 26 22:04:40 user nova-compute[72929]:     </serial>
Aug 26 22:04:40 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:04:40 user nova-compute[72929]:     <video>
Aug 26 22:04:40 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:04:40 user nova-compute[72929]:     </video>
Aug 26 22:04:40 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:04:40 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:04:40 user nova-compute[72929]:     </rng>
Aug 26 22:04:40 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:04:40 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:04:40 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:04:40 user nova-compute[72929]:     </memballoon>
Aug 26 22:04:40 user nova-compute[72929]:   </devices>
Aug 26 22:04:40 user nova-compute[72929]: </domain>
Aug 26 22:04:40 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-979185243',display_name='tempest-tempest.common.compute-instance-979185243',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-979185243',id=21,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDr7ycWbe4a18QCutvpkP7CWIG7sFeN9yLq+Fk/+9la9FZ2+WrmjN1SrIaq9M5vapNsgXhY/fqJ+zVC2xw49y0ephiZ/bKzdZoGG4k3f4lcfIHaaq0HpH7+wgK2/e4Lsg==',key_name='tempest-keypair-1072437854',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-8pqov304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:04:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=ca93842d-f13f-4b73-8e2e-06da55cdc8bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG os_vif [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb77cb74f-49, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb77cb74f-49, col_values=(('external_ids', {'iface-id': 'b77cb74f-4900-4123-9977-e70738850ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:08:ee', 'vm-uuid': 'ca93842d-f13f-4b73-8e2e-06da55cdc8bc'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:40 user nova-compute[72929]: INFO os_vif [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49')
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No VIF found with MAC fa:16:3e:d4:08:ee, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.neutron [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updated VIF entry in instance network info cache for port b77cb74f-4900-4123-9977-e70738850ef2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG nova.network.neutron [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updating instance_info_cache with network_info: [{"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:04:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1c4427d1-0440-4d15-ac5f-3525a4a81dfd req-056fcb91-e099-4849-bf27-f037d38f7e4f service nova] Releasing lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:04:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3a60c4fe-aff6-4000-b7eb-a4dabf55dfe0 req-c240e1fb-862e-44a7-9d06-4fe967dd838c service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3a60c4fe-aff6-4000-b7eb-a4dabf55dfe0 req-c240e1fb-862e-44a7-9d06-4fe967dd838c service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3a60c4fe-aff6-4000-b7eb-a4dabf55dfe0 req-c240e1fb-862e-44a7-9d06-4fe967dd838c service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3a60c4fe-aff6-4000-b7eb-a4dabf55dfe0 req-c240e1fb-862e-44a7-9d06-4fe967dd838c service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-3a60c4fe-aff6-4000-b7eb-a4dabf55dfe0 req-c240e1fb-862e-44a7-9d06-4fe967dd838c service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:42 user nova-compute[72929]: WARNING nova.compute.manager [req-3a60c4fe-aff6-4000-b7eb-a4dabf55dfe0 req-c240e1fb-862e-44a7-9d06-4fe967dd838c service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state building and task_state spawning.
Aug 26 22:04:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087484.0403163, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] VM Resumed (Lifecycle Event)
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance spawned successfully.
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087484.0467353, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] VM Started (Lifecycle Event)
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-cd470ae5-3ea2-4fc0-bf73-439938c22b8f req-ec2926df-26ae-4582-aa0b-eb7f3722ceeb service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cd470ae5-3ea2-4fc0-bf73-439938c22b8f req-ec2926df-26ae-4582-aa0b-eb7f3722ceeb service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cd470ae5-3ea2-4fc0-bf73-439938c22b8f req-ec2926df-26ae-4582-aa0b-eb7f3722ceeb service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cd470ae5-3ea2-4fc0-bf73-439938c22b8f req-ec2926df-26ae-4582-aa0b-eb7f3722ceeb service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-cd470ae5-3ea2-4fc0-bf73-439938c22b8f req-ec2926df-26ae-4582-aa0b-eb7f3722ceeb service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:44 user nova-compute[72929]: WARNING nova.compute.manager [req-cd470ae5-3ea2-4fc0-bf73-439938c22b8f req-ec2926df-26ae-4582-aa0b-eb7f3722ceeb service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state building and task_state spawning.
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 26 22:04:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:04:44 user nova-compute[72929]: INFO nova.compute.manager [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Took 6.45 seconds to build instance.
Aug 26 22:04:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f1252700-3210-4290-8695-57d1334f614c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.546s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:04:52 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:04:52 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:04:52 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[13562cec-3fe6-4c62-bca4-6fced18ad499]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:04:52 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfc9af-a63b-4d1c-8ebd-42f68b8090a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981] added
Aug 26 22:04:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e169e364-29bb-4a67-88aa-c927418387fb]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2079623f-3e70-4889-b0fc-fe97a967a1d0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBMpaOGc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBMpaOGc" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03658ab-14fc-4d3d-8016-bce592d9f126]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBMpaOGc'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[54406e0c-241c-41e0-947e-4fde5124c5e6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d3e7b-1e56-4b24-81c8-e5ea1dec23d9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb9c28f-5a45-414b-91d6-ad2c932135a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]
Aug 26 22:04:52 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.
Aug 26 22:04:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[54083d7e-8939-4408-bfdc-84a7bdfee7ca]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c0efff-b484-4723-b6e8-c2ce512dfbac]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:04:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d849fe7-3d47-4e05-8a48-56706ae6cfaf]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:04:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23961636165366161', 'path': '/dev/sdf'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961636165366161', 'path': '/dev/sdf'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:04:53 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:04:53 user nova-compute[72929]:   <source dev="/dev/sdf"/>
Aug 26 22:04:53 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:04:53 user nova-compute[72929]:   <serial>16a42b1a-1527-46b4-9e96-3c16f6c0c981</serial>
Aug 26 22:04:53 user nova-compute[72929]: </disk>
Aug 26 22:04:53 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:04:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:04:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:04:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No VIF found with MAC fa:16:3e:e0:4c:2b, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:04:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-16ecef84-68b0-4b51-9a31-0245561d7d33 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.725s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72929) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-d1c6e5c6-b366-46c3-b195-38847eed5589 req-bc863ca2-ca87-47aa-96d7-b12a7525bc53 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d1c6e5c6-b366-46c3-b195-38847eed5589 req-bc863ca2-ca87-47aa-96d7-b12a7525bc53 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d1c6e5c6-b366-46c3-b195-38847eed5589 req-bc863ca2-ca87-47aa-96d7-b12a7525bc53 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d1c6e5c6-b366-46c3-b195-38847eed5589 req-bc863ca2-ca87-47aa-96d7-b12a7525bc53 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-d1c6e5c6-b366-46c3-b195-38847eed5589 req-bc863ca2-ca87-47aa-96d7-b12a7525bc53 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:56 user nova-compute[72929]: WARNING nova.compute.manager [req-d1c6e5c6-b366-46c3-b195-38847eed5589 req-bc863ca2-ca87-47aa-96d7-b12a7525bc53 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state active and task_state powering-off.
Aug 26 22:04:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:56 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance destroyed successfully.
Aug 26 22:04:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:04:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8cd27151-a26f-43fe-b676-d3bd3c7822df tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.909s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:58 user nova-compute[72929]: DEBUG nova.compute.manager [req-4fce09af-8d7f-4dcd-9bdc-47f9effad9e1 req-70ad1aac-409a-4e26-941f-aca967b63822 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:04:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4fce09af-8d7f-4dcd-9bdc-47f9effad9e1 req-70ad1aac-409a-4e26-941f-aca967b63822 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4fce09af-8d7f-4dcd-9bdc-47f9effad9e1 req-70ad1aac-409a-4e26-941f-aca967b63822 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4fce09af-8d7f-4dcd-9bdc-47f9effad9e1 req-70ad1aac-409a-4e26-941f-aca967b63822 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:58 user nova-compute[72929]: DEBUG nova.compute.manager [req-4fce09af-8d7f-4dcd-9bdc-47f9effad9e1 req-70ad1aac-409a-4e26-941f-aca967b63822 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:04:58 user nova-compute[72929]: WARNING nova.compute.manager [req-4fce09af-8d7f-4dcd-9bdc-47f9effad9e1 req-70ad1aac-409a-4e26-941f-aca967b63822 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state stopped and task_state None.
Aug 26 22:04:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG nova.objects.instance [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lazy-loading 'flavor' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:04:59 user nova-compute[72929]: INFO nova.compute.manager [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Attaching volume dda2bf55-3dd4-49ef-a62d-f0b6a2770738 to /dev/vdb
Aug 26 22:04:59 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9ec161-e2ee-4ecc-a5fd-3c96e06c6de1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb585f-eb3f-47bd-9f00-8af6625dd4cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b5676-c8bc-4206-b077-f8d638231e6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[750941b3-ac67-485c-a368-c046a41b0679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:04:59 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:04:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf59cec-4ef4-4e92-86f6-949923c4fa5a]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG os_brick.utils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:04:59 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updating existing volume attachment record: 7824df4d-66a8-4c38-b5ec-53bca7093625 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-changed-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Refreshing instance network info cache due to event network-changed-a0af43a8-699d-42b1-9621-0eb0e934ce29. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] Acquiring lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] Acquired lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Refreshing network info cache for port a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:05:00 user nova-compute[72929]: INFO nova.compute.claims [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Claim successful on node user
Aug 26 22:05:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:05:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:05:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.policy [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c667638141d429e925ecd38af6423fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c177bf6e804c3292dab6eaf860934d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:05:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Creating image(s)
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "/opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "/opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updated VIF entry in instance network info cache for port a0af43a8-699d-42b1-9621-0eb0e934ce29. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updating instance_info_cache with network_info: [{"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed4db9a1-9e0d-4e54-b326-74537d42fec9 req-2884b7b8-693b-43d3-86f5-b3657f00ff40 service nova] Releasing lock "refresh_cache-0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk 1073741824" returned: 0 in 0.069s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:01 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Successfully created port: 86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Cannot resize image /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Ensure instance console log exists: /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Successfully updated port: 86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquired lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-changed-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Refreshing instance network info cache due to event network-changed-86ee989f-5505-4562-bd79-24f1d5489e44. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] Acquiring lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:05:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Updating instance_info_cache with network_info: [{"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Releasing lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Instance network_info: |[{"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] Acquired lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Refreshing network info cache for port 86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Start _get_guest_xml network_info=[{"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:05:03 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:05:03 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2051082546',display_name='tempest-ServersNegativeTestJSON-server-2051082546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2051082546',id=22,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c177bf6e804c3292dab6eaf860934d',ramdisk_id='',reservation_id='r-99088i6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789296540',owner_user_name='tempest-ServersNegativeTestJSON-789296540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:05:01Z,user_data=None,user_id='9c667638141d429e925ecd38af6423fc',uuid=bc831d2d-9dae-4c2a-8514-eb8eb782e3e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converting VIF {"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lazy-loading 'pci_devices' on Instance uuid bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:05:03 user nova-compute[72929]:   <uuid>bc831d2d-9dae-4c2a-8514-eb8eb782e3e8</uuid>
Aug 26 22:05:03 user nova-compute[72929]:   <name>instance-00000016</name>
Aug 26 22:05:03 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:05:03 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:05:03 user nova-compute[72929]:   <metadata>
Aug 26 22:05:03 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:05:03 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:05:03 user nova-compute[72929]:       <nova:name>tempest-ServersNegativeTestJSON-server-2051082546</nova:name>
Aug 26 22:05:03 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:05:03</nova:creationTime>
Aug 26 22:05:03 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:05:03 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:05:03 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:05:03 user nova-compute[72929]:       <nova:owner>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:user uuid="9c667638141d429e925ecd38af6423fc">tempest-ServersNegativeTestJSON-789296540-project-member</nova:user>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:project uuid="60c177bf6e804c3292dab6eaf860934d">tempest-ServersNegativeTestJSON-789296540</nova:project>
Aug 26 22:05:03 user nova-compute[72929]:       </nova:owner>
Aug 26 22:05:03 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:05:03 user nova-compute[72929]:       <nova:ports>
Aug 26 22:05:03 user nova-compute[72929]:         <nova:port uuid="86ee989f-5505-4562-bd79-24f1d5489e44">
Aug 26 22:05:03 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 22:05:03 user nova-compute[72929]:         </nova:port>
Aug 26 22:05:03 user nova-compute[72929]:       </nova:ports>
Aug 26 22:05:03 user nova-compute[72929]:     </nova:instance>
Aug 26 22:05:03 user nova-compute[72929]:   </metadata>
Aug 26 22:05:03 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:05:03 user nova-compute[72929]:     <system>
Aug 26 22:05:03 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:05:03 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:05:03 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:05:03 user nova-compute[72929]:       <entry name="serial">bc831d2d-9dae-4c2a-8514-eb8eb782e3e8</entry>
Aug 26 22:05:03 user nova-compute[72929]:       <entry name="uuid">bc831d2d-9dae-4c2a-8514-eb8eb782e3e8</entry>
Aug 26 22:05:03 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:05:03 user nova-compute[72929]:     </system>
Aug 26 22:05:03 user nova-compute[72929]:   </sysinfo>
Aug 26 22:05:03 user nova-compute[72929]:   <os>
Aug 26 22:05:03 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:05:03 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:05:03 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:05:03 user nova-compute[72929]:   </os>
Aug 26 22:05:03 user nova-compute[72929]:   <features>
Aug 26 22:05:03 user nova-compute[72929]:     <acpi/>
Aug 26 22:05:03 user nova-compute[72929]:     <apic/>
Aug 26 22:05:03 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:05:03 user nova-compute[72929]:   </features>
Aug 26 22:05:03 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:05:03 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:05:03 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:05:03 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:05:03 user nova-compute[72929]:   </clock>
Aug 26 22:05:03 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:05:03 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:05:03 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:05:03 user nova-compute[72929]:   </cpu>
Aug 26 22:05:03 user nova-compute[72929]:   <devices>
Aug 26 22:05:03 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:05:03 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:05:03 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk"/>
Aug 26 22:05:03 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:05:03 user nova-compute[72929]:     </disk>
Aug 26 22:05:03 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:05:03 user nova-compute[72929]:       <mac address="fa:16:3e:fa:5e:d8"/>
Aug 26 22:05:03 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:05:03 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:05:03 user nova-compute[72929]:       <target dev="tap86ee989f-55"/>
Aug 26 22:05:03 user nova-compute[72929]:     </interface>
Aug 26 22:05:03 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:05:03 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/console.log" append="off"/>
Aug 26 22:05:03 user nova-compute[72929]:     </serial>
Aug 26 22:05:03 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:05:03 user nova-compute[72929]:     <video>
Aug 26 22:05:03 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:05:03 user nova-compute[72929]:     </video>
Aug 26 22:05:03 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:05:03 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:05:03 user nova-compute[72929]:     </rng>
Aug 26 22:05:03 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:05:03 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:05:03 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:05:03 user nova-compute[72929]:     </memballoon>
Aug 26 22:05:03 user nova-compute[72929]:   </devices>
Aug 26 22:05:03 user nova-compute[72929]: </domain>
Aug 26 22:05:03 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2051082546',display_name='tempest-ServersNegativeTestJSON-server-2051082546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2051082546',id=22,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c177bf6e804c3292dab6eaf860934d',ramdisk_id='',reservation_id='r-99088i6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789296540',owner_user_name='tempest-ServersNegativeTestJSON-789296540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:05:01Z,user_data=None,user_id='9c667638141d429e925ecd38af6423fc',uuid=bc831d2d-9dae-4c2a-8514-eb8eb782e3e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converting VIF {"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG os_vif [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86ee989f-55, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86ee989f-55, col_values=(('external_ids', {'iface-id': '86ee989f-5505-4562-bd79-24f1d5489e44', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:5e:d8', 'vm-uuid': 'bc831d2d-9dae-4c2a-8514-eb8eb782e3e8'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:03 user nova-compute[72929]: INFO os_vif [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55')
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] No VIF found with MAC fa:16:3e:fa:5e:d8, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Updated VIF entry in instance network info cache for port 86ee989f-5505-4562-bd79-24f1d5489e44. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Updating instance_info_cache with network_info: [{"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7eb7c3f4-3589-4be3-b277-d05cede6387e req-62a3bafe-81bf-4cc3-a6f8-01adc7dbea5a service nova] Releasing lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:05:04 user nova-compute[72929]: INFO nova.compute.claims [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Claim successful on node user
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.723s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:05:04 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:05:04 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:05:05 user nova-compute[72929]: INFO nova.compute.manager [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Detaching volume c5d35e33-b6ef-40dd-96be-50425b6e8946
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-406b507b-71e8-4172-996e-256b95370c0a req-d2be6d49-ca44-468e-a951-a81dc04b0b33 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-406b507b-71e8-4172-996e-256b95370c0a req-d2be6d49-ca44-468e-a951-a81dc04b0b33 service nova] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-406b507b-71e8-4172-996e-256b95370c0a req-d2be6d49-ca44-468e-a951-a81dc04b0b33 service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-406b507b-71e8-4172-996e-256b95370c0a req-d2be6d49-ca44-468e-a951-a81dc04b0b33 service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-406b507b-71e8-4172-996e-256b95370c0a req-d2be6d49-ca44-468e-a951-a81dc04b0b33 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] No waiting events found dispatching network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:05 user nova-compute[72929]: WARNING nova.compute.manager [req-406b507b-71e8-4172-996e-256b95370c0a req-d2be6d49-ca44-468e-a951-a81dc04b0b33 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received unexpected event network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 for instance with vm_state building and task_state spawning.
Aug 26 22:05:05 user nova-compute[72929]: INFO nova.virt.block_device [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attempting to driver detach volume c5d35e33-b6ef-40dd-96be-50425b6e8946 from mountpoint /dev/vdb
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Attempting to detach device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:05:05 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:05:05 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:05:05 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:05:05 user nova-compute[72929]:   <serial>c5d35e33-b6ef-40dd-96be-50425b6e8946</serial>
Aug 26 22:05:05 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:05:05 user nova-compute[72929]: </disk>
Aug 26 22:05:05 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.policy [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf32662e1a4e466781518d4fdd63cb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22dd3139d0af4e319ee02bff3155650b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:05:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully detached device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the persistent domain config.
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:05:05 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:05:05 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:05:05 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:05:05 user nova-compute[72929]:   <serial>c5d35e33-b6ef-40dd-96be-50425b6e8946</serial>
Aug 26 22:05:05 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:05:05 user nova-compute[72929]: </disk>
Aug 26 22:05:05 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:05:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Creating image(s)
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087505.6830835, 3db3d467-df63-4ea0-951b-4eee4460980f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:05:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully detached device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the live domain config.
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hWflduKn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:05 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk 1073741824" returned: 0 in 0.069s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a45b6-4735-49ad-9039-71637705bd40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0ace87-2f0c-4a79-92b6-d966f1f130d2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:05 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803d81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e182a17-bfe3-46ad-bead-16ea125fcbb6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800ca04-7e3d-4a44-adc9-aa49bb2611b3]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5979701-50d8-4da6-bfd3-296a42804050]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.219s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc9328c-749c-443a-8520-6bcd2f7ebbb4]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[41446d44-76cc-42b1-8d62-fec4386532a9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0784e5ec-cb5d-4960-9406-09481c64c180]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260]
Aug 26 22:05:06 user nova-compute[72929]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:06 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Successfully created port: 31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5d35e33-b6ef-40dd-96be-50425b6e8946 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cc99c5-09e9-4558-a20b-c989c6b6f5ff]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Cannot resize image /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Ensure instance console log exists: /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.475s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== disconnect_volume: return (478ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Successfully updated port: 31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5b9f9432-0fa1-4dce-b5df-e43598fbbc6f tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.045s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] No waiting events found dispatching network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:07 user nova-compute[72929]: WARNING nova.compute.manager [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received unexpected event network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 for instance with vm_state building and task_state spawning.
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing instance network info cache due to event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087507.2285895, bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] VM Resumed (Lifecycle Event)
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Instance spawned successfully.
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087507.2289085, bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] VM Started (Lifecycle Event)
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance network_info: |[{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Start _get_guest_xml network_info=[{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:05:07 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:05:07 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:05:07 user nova-compute[72929]: INFO nova.compute.manager [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Took 7.10 seconds to build instance.
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-738784921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-738784921',id=23,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfNpwEcgMoxwh1kvGHHdd6/D1xmuG4A8l5F1mE9k0yQA+NLV/dyW1tqMh/GoiJ6T8r1WS8RAWQueqpULpn/3q31K80VMxZGdCgH1yzS/MrTzni1jf6oYHlcdq6HAQdZg==',key_name='tempest-keypair-1698526643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-ujoxx46c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:05:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=387ba104-895e-433c-a100-51b98acf8c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'pci_devices' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7f7d1cef-fe63-4499-a682-7dcd7a51c397 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.252s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:05:07 user nova-compute[72929]:   <uuid>387ba104-895e-433c-a100-51b98acf8c15</uuid>
Aug 26 22:05:07 user nova-compute[72929]:   <name>instance-00000017</name>
Aug 26 22:05:07 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:05:07 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:05:07 user nova-compute[72929]:   <metadata>
Aug 26 22:05:07 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:05:07 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:05:07 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-738784921</nova:name>
Aug 26 22:05:07 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:05:07</nova:creationTime>
Aug 26 22:05:07 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:05:07 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:05:07 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:05:07 user nova-compute[72929]:       <nova:owner>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:user uuid="cf32662e1a4e466781518d4fdd63cb76">tempest-AttachVolumeShelveTestJSON-1476482184-project-member</nova:user>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:project uuid="22dd3139d0af4e319ee02bff3155650b">tempest-AttachVolumeShelveTestJSON-1476482184</nova:project>
Aug 26 22:05:07 user nova-compute[72929]:       </nova:owner>
Aug 26 22:05:07 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:05:07 user nova-compute[72929]:       <nova:ports>
Aug 26 22:05:07 user nova-compute[72929]:         <nova:port uuid="31f5f5c0-90be-4968-af17-b2fa7ea45f29">
Aug 26 22:05:07 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 22:05:07 user nova-compute[72929]:         </nova:port>
Aug 26 22:05:07 user nova-compute[72929]:       </nova:ports>
Aug 26 22:05:07 user nova-compute[72929]:     </nova:instance>
Aug 26 22:05:07 user nova-compute[72929]:   </metadata>
Aug 26 22:05:07 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:05:07 user nova-compute[72929]:     <system>
Aug 26 22:05:07 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:05:07 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:05:07 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:05:07 user nova-compute[72929]:       <entry name="serial">387ba104-895e-433c-a100-51b98acf8c15</entry>
Aug 26 22:05:07 user nova-compute[72929]:       <entry name="uuid">387ba104-895e-433c-a100-51b98acf8c15</entry>
Aug 26 22:05:07 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:05:07 user nova-compute[72929]:     </system>
Aug 26 22:05:07 user nova-compute[72929]:   </sysinfo>
Aug 26 22:05:07 user nova-compute[72929]:   <os>
Aug 26 22:05:07 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:05:07 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:05:07 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:05:07 user nova-compute[72929]:   </os>
Aug 26 22:05:07 user nova-compute[72929]:   <features>
Aug 26 22:05:07 user nova-compute[72929]:     <acpi/>
Aug 26 22:05:07 user nova-compute[72929]:     <apic/>
Aug 26 22:05:07 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:05:07 user nova-compute[72929]:   </features>
Aug 26 22:05:07 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:05:07 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:05:07 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:05:07 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:05:07 user nova-compute[72929]:   </clock>
Aug 26 22:05:07 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:05:07 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:05:07 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:05:07 user nova-compute[72929]:   </cpu>
Aug 26 22:05:07 user nova-compute[72929]:   <devices>
Aug 26 22:05:07 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:05:07 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:05:07 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk"/>
Aug 26 22:05:07 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:05:07 user nova-compute[72929]:     </disk>
Aug 26 22:05:07 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:05:07 user nova-compute[72929]:       <mac address="fa:16:3e:e1:be:fe"/>
Aug 26 22:05:07 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:05:07 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:05:07 user nova-compute[72929]:       <target dev="tap31f5f5c0-90"/>
Aug 26 22:05:07 user nova-compute[72929]:     </interface>
Aug 26 22:05:07 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:05:07 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/console.log" append="off"/>
Aug 26 22:05:07 user nova-compute[72929]:     </serial>
Aug 26 22:05:07 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:05:07 user nova-compute[72929]:     <video>
Aug 26 22:05:07 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:05:07 user nova-compute[72929]:     </video>
Aug 26 22:05:07 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:05:07 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:05:07 user nova-compute[72929]:     </rng>
Aug 26 22:05:07 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:05:07 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:05:07 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:05:07 user nova-compute[72929]:     </memballoon>
Aug 26 22:05:07 user nova-compute[72929]:   </devices>
Aug 26 22:05:07 user nova-compute[72929]: </domain>
Aug 26 22:05:07 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-738784921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-738784921',id=23,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfNpwEcgMoxwh1kvGHHdd6/D1xmuG4A8l5F1mE9k0yQA+NLV/dyW1tqMh/GoiJ6T8r1WS8RAWQueqpULpn/3q31K80VMxZGdCgH1yzS/MrTzni1jf6oYHlcdq6HAQdZg==',key_name='tempest-keypair-1698526643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-ujoxx46c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:05:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=387ba104-895e-433c-a100-51b98acf8c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG os_vif [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31f5f5c0-90, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31f5f5c0-90, col_values=(('external_ids', {'iface-id': '31f5f5c0-90be-4968-af17-b2fa7ea45f29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:be:fe', 'vm-uuid': '387ba104-895e-433c-a100-51b98acf8c15'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:07 user nova-compute[72929]: INFO os_vif [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90')
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No VIF found with MAC fa:16:3e:e1:be:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:05:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updated VIF entry in instance network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:05:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eba1a194-dd5f-4bc7-b880-88179e054d8f req-30df0a8c-3f0a-4ed9-a98b-cab23d456b85 service nova] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-e387365f-7988-4582-8e56-ef8f82a89aa9 req-982e908d-83e5-4946-98ed-66df9601df72 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e387365f-7988-4582-8e56-ef8f82a89aa9 req-982e908d-83e5-4946-98ed-66df9601df72 service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e387365f-7988-4582-8e56-ef8f82a89aa9 req-982e908d-83e5-4946-98ed-66df9601df72 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e387365f-7988-4582-8e56-ef8f82a89aa9 req-982e908d-83e5-4946-98ed-66df9601df72 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-e387365f-7988-4582-8e56-ef8f82a89aa9 req-982e908d-83e5-4946-98ed-66df9601df72 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:09 user nova-compute[72929]: WARNING nova.compute.manager [req-e387365f-7988-4582-8e56-ef8f82a89aa9 req-982e908d-83e5-4946-98ed-66df9601df72 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state building and task_state spawning.
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087511.2199235, 387ba104-895e-433c-a100-51b98acf8c15 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] VM Resumed (Lifecycle Event)
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance spawned successfully.
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087511.2212558, 387ba104-895e-433c-a100-51b98acf8c15 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] VM Started (Lifecycle Event)
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Took 6.13 seconds to spawn the instance on the hypervisor.
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-515e69ef-a0d8-47d6-985a-3ef3fab44ba7 req-bb1e1e29-1623-42cf-99c9-cd9c8f251646 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-515e69ef-a0d8-47d6-985a-3ef3fab44ba7 req-bb1e1e29-1623-42cf-99c9-cd9c8f251646 service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-515e69ef-a0d8-47d6-985a-3ef3fab44ba7 req-bb1e1e29-1623-42cf-99c9-cd9c8f251646 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-515e69ef-a0d8-47d6-985a-3ef3fab44ba7 req-bb1e1e29-1623-42cf-99c9-cd9c8f251646 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-515e69ef-a0d8-47d6-985a-3ef3fab44ba7 req-bb1e1e29-1623-42cf-99c9-cd9c8f251646 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:11 user nova-compute[72929]: WARNING nova.compute.manager [req-515e69ef-a0d8-47d6-985a-3ef3fab44ba7 req-bb1e1e29-1623-42cf-99c9-cd9c8f251646 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state building and task_state spawning.
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Took 7.31 seconds to build instance.
Aug 26 22:05:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b7e37031-dbf6-4eba-ade6-3597683cc6b7 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.476s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087496.4899096, a0172f33-06bb-404d-8fb0-c88927e84bdd => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:05:11 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Stopped (Lifecycle Event)
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b07b71a6-27e1-4a37-b3fd-25ab397abe75 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b07b71a6-27e1-4a37-b3fd-25ab397abe75 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:12 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:12 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:12 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ac544a-7d2f-4852-9e9c-c5869fa9e6ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:05:12 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5ed10a-56da-4a9e-856c-63477b576c38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738] added
Aug 26 22:05:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c093099a-32c0-4472-b6c7-466c1568d0f1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e160a45c-b38a-4fd2-b061-84402e6c95e1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKkDwFOo {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKkDwFOo" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04d4b1-229a-425f-aaf5-1e79d92e2c6b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKkDwFOo'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7076fdbf-1a27-4512-a2fb-c1362f5dc7bd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d1a89-860d-4df2-8572-a1c50c6f5f37]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc3efa-e916-4b84-bb9a-e081ac661f8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]
Aug 26 22:05:12 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf0bbcb-6beb-483f-9a29-f37714930135]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[31db478a-9277-43f3-b860-1c38d66ae239]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:05:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30b946c-99ac-4fa8-8bea-33c5c4b6b94e]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-changed-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Refreshing instance network info cache due to event network-changed-7a8d4c8c-2672-4af8-b42e-54be12e2544e. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Refreshing network info cache for port 7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updated VIF entry in instance network info cache for port 7a8d4c8c-2672-4af8-b42e-54be12e2544e. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-61fbb82f-26e1-4875-9b61-2b592c1b9d00 req-3f100d0e-e57d-400a-9b5b-8f533030d933 service nova] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23230643130383266', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230643130383266', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG nova.objects.instance [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lazy-loading 'flavor' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:05:14 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:05:14 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:05:14 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:05:14 user nova-compute[72929]:   <serial>dda2bf55-3dd4-49ef-a62d-f0b6a2770738</serial>
Aug 26 22:05:14 user nova-compute[72929]: </disk>
Aug 26 22:05:14 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] No VIF found with MAC fa:16:3e:7c:a4:99, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:05:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2c4cc598-8973-4406-b025-440367b80ad2 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.008s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-changed-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing instance network info cache due to event network-changed-ce43e3fe-6244-47f7-a62d-5dcf19718f2e. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] Acquiring lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] Acquired lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Refreshing network info cache for port ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG os_brick.utils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46ca191-6503-4f7a-adf9-ed222f5e51ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de8d35-cbbf-46ff-8093-ece922a3a73a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec088f0-e860-44a6-aedd-a170000efecc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6907f39-e69e-4ba1-84c2-9122acc3252b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:05:15 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2eb6ca-cfe0-455f-8ff9-f8466a049c9c]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG os_brick.utils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:15 user nova-compute[72929]: INFO nova.compute.manager [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Swapping volume dda2bf55-3dd4-49ef-a62d-f0b6a2770738 for 408489a8-82da-4480-ad5c-11dd3ed545cb
Aug 26 22:05:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updated VIF entry in instance network info cache for port ce43e3fe-6244-47f7-a62d-5dcf19718f2e. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a02eeb85-03e7-4f1d-a40f-bbd3e85f347c req-6715f922-cf00-4993-8fc0-95f3a0f07ae8 service nova] Releasing lock "refresh_cache-c9099ee1-f916-4e61-ae3c-037b12780060" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "c9099ee1-f916-4e61-ae3c-037b12780060" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:18 user nova-compute[72929]: INFO nova.compute.manager [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Terminating instance
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-517cb56d-3ecb-40ae-85a7-9b856ebc8c40 req-7380f90f-a951-4ba4-ba56-82676654a26b service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-517cb56d-3ecb-40ae-85a7-9b856ebc8c40 req-7380f90f-a951-4ba4-ba56-82676654a26b service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-517cb56d-3ecb-40ae-85a7-9b856ebc8c40 req-7380f90f-a951-4ba4-ba56-82676654a26b service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-517cb56d-3ecb-40ae-85a7-9b856ebc8c40 req-7380f90f-a951-4ba4-ba56-82676654a26b service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-517cb56d-3ecb-40ae-85a7-9b856ebc8c40 req-7380f90f-a951-4ba4-ba56-82676654a26b service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-517cb56d-3ecb-40ae-85a7-9b856ebc8c40 req-7380f90f-a951-4ba4-ba56-82676654a26b service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-790e19f9-a806-417d-bc0d-092e0303458f req-97367ac8-1c82-4f9e-a52b-3eae2877dc15 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-790e19f9-a806-417d-bc0d-092e0303458f req-97367ac8-1c82-4f9e-a52b-3eae2877dc15 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-790e19f9-a806-417d-bc0d-092e0303458f req-97367ac8-1c82-4f9e-a52b-3eae2877dc15 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-790e19f9-a806-417d-bc0d-092e0303458f req-97367ac8-1c82-4f9e-a52b-3eae2877dc15 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-790e19f9-a806-417d-bc0d-092e0303458f req-97367ac8-1c82-4f9e-a52b-3eae2877dc15 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-790e19f9-a806-417d-bc0d-092e0303458f req-97367ac8-1c82-4f9e-a52b-3eae2877dc15 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-0618bd0f-c82f-48e5-bcc6-0e5d0ad044cd req-6e8e51f1-214b-47b8-a7bf-97be05582630 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0618bd0f-c82f-48e5-bcc6-0e5d0ad044cd req-6e8e51f1-214b-47b8-a7bf-97be05582630 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0618bd0f-c82f-48e5-bcc6-0e5d0ad044cd req-6e8e51f1-214b-47b8-a7bf-97be05582630 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0618bd0f-c82f-48e5-bcc6-0e5d0ad044cd req-6e8e51f1-214b-47b8-a7bf-97be05582630 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-0618bd0f-c82f-48e5-bcc6-0e5d0ad044cd req-6e8e51f1-214b-47b8-a7bf-97be05582630 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-0618bd0f-c82f-48e5-bcc6-0e5d0ad044cd req-6e8e51f1-214b-47b8-a7bf-97be05582630 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-5339e07e-21f2-4011-ad90-24450d275c81 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Instance destroyed successfully.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.objects.instance [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lazy-loading 'resources' on Instance uuid c9099ee1-f916-4e61-ae3c-037b12780060 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce43e3fe-62, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:46:aa,bridge_name='br-int',has_traffic_filtering=True,id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e,network=Network(8bdd60b5-235f-4b88-aca2-3ee290f41a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce43e3fe-62')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba716c16-1c, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:c1:72,bridge_name='br-int',has_traffic_filtering=True,id=ba716c16-1cc3-43be-82c6-1aefbb4b546c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba716c16-1c')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa460343c-e0, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:13:43,bridge_name='br-int',has_traffic_filtering=True,id=a460343c-e064-4ea3-9fef-306db40e74d2,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa460343c-e0')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aa5c2be-73, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:21,bridge_name='br-int',has_traffic_filtering=True,id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa5c2be-73')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "address": "fa:16:3e:98:b0:64", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.15", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb63a22c2-49", "ovs_interfaceid": "b63a22c2-4938-4dbd-a31d-b1f12749600c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb63a22c2-49, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-ce43e3fe-6244-47f7-a62d-5dcf19718f2e for instance with vm_state active and task_state deleting.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-a460343c-e064-4ea3-9fef-306db40e74d2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-a460343c-e064-4ea3-9fef-306db40e74d2 for instance with vm_state active and task_state deleting.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-b63a22c2-4938-4dbd-a31d-b1f12749600c for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-b63a22c2-4938-4dbd-a31d-b1f12749600c for instance with vm_state active and task_state deleting.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING nova.compute.manager [req-59618a2d-b36d-4a81-86ef-92f8358ae3c8 req-94153af6-c519-4f46-9c48-ff5e233f9638 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 for instance with vm_state active and task_state deleting.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b0:64,bridge_name='br-int',has_traffic_filtering=True,id=b63a22c2-4938-4dbd-a31d-b1f12749600c,network=Network(5fe4ef2f-3179-43f6-b0ec-74ef541886d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb63a22c2-49')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5339e07e-21, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-ba716c16-1cc3-43be-82c6-1aefbb4b546c for instance with vm_state active and task_state deleting.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-unplugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-unplugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING nova.compute.manager [req-98c249a0-878a-43e6-b974-9a696631a747 req-c51f0ac5-09e5-45f6-b353-b647e8281557 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 for instance with vm_state active and task_state deleting.
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f4:f5,bridge_name='br-int',has_traffic_filtering=True,id=5339e07e-21f2-4011-ad90-24450d275c81,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5339e07e-21')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-26T22:02:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1634538895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1634538895',id=16,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiaxY6KwvDIq+LCMaA1hFftNsYJkpoR/SQasT0JMNrRjGocTa16+sIVjonbK2sLrX6Qg1W6aaUsjm8dAh0tHLY6fgx7NlkQP6GnKF6qcTymh/aHMjcR5xPxej2ZVj61IA==',key_name='tempest-keypair-343314757',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e19f8fd7146d45069390beebe8dab168',ramdisk_id='',reservation_id='r-3cuia3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1916206492',owner_user_name='tempest-TaggedBootDevicesTest_v242-1916206492-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45e307804f7149829c188e99040c5049',uuid=c9099ee1-f916-4e61-ae3c-037b12780060,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converting VIF {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bdcacca-0d, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:20 user nova-compute[72929]: INFO os_vif [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:7d:28,bridge_name='br-int',has_traffic_filtering=True,id=8bdcacca-0de9-49f7-b11f-03fa3957e7b3,network=Network(f6666d92-e7b9-48a1-9994-2b9994e46099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bdcacca-0d')
Aug 26 22:05:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPcJDVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:20 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[214a5c5b-1354-4e68-8d82-017ea6a2d008]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[475e4ece-9419-43d2-9b40-1d0a1a53a728]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:20 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b982a64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa8728b-a12b-407f-bc0b-16083b0338e9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3824a277-8970-406e-b6eb-0c01a88ae018]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b350ac-5f65-4768-8c24-3c06caa76635]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63f9c62-3325-43dd-8153-93fbbd8de29f]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8bdf77-fe0b-4c51-8595-e82f32669c87]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2955e3-0ae8-40c5-a7a9-6623ff2ee624]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260]
Aug 26 22:05:21 user nova-compute[72929]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1daeb1e5-7156-41c1-a393-5be19d5bdd2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c9d65-47ec-4cf2-9549-6490f8e657df]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== disconnect_volume: return (325ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OZzfxSVQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:21 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5dad2e-a47f-40a9-9850-c41648ef4a6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd73823-ec54-4073-83c0-eedfc39600af]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b982a64d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a452f373-7ad7-4dff-8e7a-af4007baecdc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b6b62-7a2d-416d-bfbd-ff843db67e21]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-6777d50a-3c5d-499c-a2db-6d6163e9d096 req-fcc38ad0-ac7b-4179-a040-ce8247786db7 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6777d50a-3c5d-499c-a2db-6d6163e9d096 req-fcc38ad0-ac7b-4179-a040-ce8247786db7 service nova] Acquiring lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6777d50a-3c5d-499c-a2db-6d6163e9d096 req-fcc38ad0-ac7b-4179-a040-ce8247786db7 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6777d50a-3c5d-499c-a2db-6d6163e9d096 req-fcc38ad0-ac7b-4179-a040-ce8247786db7 service nova] Lock "c9099ee1-f916-4e61-ae3c-037b12780060-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-6777d50a-3c5d-499c-a2db-6d6163e9d096 req-fcc38ad0-ac7b-4179-a040-ce8247786db7 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] No waiting events found dispatching network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:05:21 user nova-compute[72929]: WARNING nova.compute.manager [req-6777d50a-3c5d-499c-a2db-6d6163e9d096 req-fcc38ad0-ac7b-4179-a040-ce8247786db7 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received unexpected event network-vif-plugged-5339e07e-21f2-4011-ad90-24450d275c81 for instance with vm_state active and task_state deleting.
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af328e-6159-4c0c-a195-f13db1197782]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60f5b56-8762-49f2-a6b1-bc2f5d791c42]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdda826-2140-4565-b9cf-3aed369220cd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4aa343-9b3c-461a-9261-5f23fe6b004c]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260]
Aug 26 22:05:21 user nova-compute[72929]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef058ced-a091-4c28-9f4e-2dd6799328c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c69b13-aae0-461c-bc78-36b3382144f4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== disconnect_volume: return (461ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BdtXNEUP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:21 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa566053-d4c8-4305-aaec-37dcc4a88f33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e3a362-266e-4ef0-814c-77cf7279b6f7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b982a5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[255656cd-a27c-42cd-9f42-51cbeb5cc09d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[85095936-b47b-4dc0-940b-e00d6c5ec4b3]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b1c97-a785-4358-ba5a-54c570f39cf5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29bccb-3d78-4a01-87ea-539ffc22fe43]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f796335-2186-4b85-8eab-23ef544428d7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a1681-b653-4064-89be-5ad3d18ee19f]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260]
Aug 26 22:05:21 user nova-compute[72929]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad34fc6-5480-42cc-9f6c-06608b0de9d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca35643-c330-41ad-a781-329bbd1aee8a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] <== disconnect_volume: return (360ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Deleting instance files /opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060_del
Aug 26 22:05:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Deletion of /opt/stack/data/nova/instances/c9099ee1-f916-4e61-ae3c-037b12780060_del complete
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:22 user nova-compute[72929]: INFO nova.compute.manager [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Took 3.93 seconds to destroy the instance on the hypervisor.
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:05:22 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid 'c9099ee1-f916-4e61-ae3c-037b12780060' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c9099ee1-f916-4e61-ae3c-037b12780060' (instance-00000010)
Aug 26 22:05:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:23 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:05:23 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=24.375659942626953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c9099ee1-f916-4e61-ae3c-037b12780060 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 63d06f04-417d-4f92-bf7c-d4809e518d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 387ba104-895e-433c-a100-51b98acf8c15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:05:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-3ffc4112-3b2a-4412-a292-ebbb4777b550 req-8bd2d962-a642-4313-b09c-86a338d22cda service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-deleted-b63a22c2-4938-4dbd-a31d-b1f12749600c {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:24 user nova-compute[72929]: INFO nova.compute.manager [req-3ffc4112-3b2a-4412-a292-ebbb4777b550 req-8bd2d962-a642-4313-b09c-86a338d22cda service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Neutron deleted interface b63a22c2-4938-4dbd-a31d-b1f12749600c; detaching it from the instance and deleting it from the info cache
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-3ffc4112-3b2a-4412-a292-ebbb4777b550 req-8bd2d962-a642-4313-b09c-86a338d22cda service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5339e07e-21f2-4011-ad90-24450d275c81", "address": "fa:16:3e:2e:f4:f5", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5339e07e-21", "ovs_interfaceid": "5339e07e-21f2-4011-ad90-24450d275c81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-3ffc4112-3b2a-4412-a292-ebbb4777b550 req-8bd2d962-a642-4313-b09c-86a338d22cda service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Detach interface failed, port_id=b63a22c2-4938-4dbd-a31d-b1f12749600c, reason: Instance c9099ee1-f916-4e61-ae3c-037b12780060 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Skipping network cache update for instance because it is being deleted. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:05:24 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:05:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-deleted-5339e07e-21f2-4011-ad90-24450d275c81 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:26 user nova-compute[72929]: INFO nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Neutron deleted interface 5339e07e-21f2-4011-ad90-24450d275c81; detaching it from the instance and deleting it from the info cache
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "address": "fa:16:3e:3c:b2:21", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa5c2be-73", "ovs_interfaceid": "4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Detach interface failed, port_id=5339e07e-21f2-4011-ad90-24450d275c81, reason: Instance c9099ee1-f916-4e61-ae3c-037b12780060 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-deleted-4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:26 user nova-compute[72929]: INFO nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Neutron deleted interface 4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351; detaching it from the instance and deleting it from the info cache
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "address": "fa:16:3e:e7:46:aa", "network": {"id": "8bdd60b5-235f-4b88-aca2-3ee290f41a7b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-838866469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce43e3fe-62", "ovs_interfaceid": "ce43e3fe-6244-47f7-a62d-5dcf19718f2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Detach interface failed, port_id=4aa5c2be-73b0-4ed8-93eb-cdfe2a28d351, reason: Instance c9099ee1-f916-4e61-ae3c-037b12780060 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-deleted-ce43e3fe-6244-47f7-a62d-5dcf19718f2e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:26 user nova-compute[72929]: INFO nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Neutron deleted interface ce43e3fe-6244-47f7-a62d-5dcf19718f2e; detaching it from the instance and deleting it from the info cache
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [{"id": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "address": "fa:16:3e:5d:c1:72", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba716c16-1c", "ovs_interfaceid": "ba716c16-1cc3-43be-82c6-1aefbb4b546c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a460343c-e064-4ea3-9fef-306db40e74d2", "address": "fa:16:3e:5a:13:43", "network": {"id": "5fe4ef2f-3179-43f6-b0ec-74ef541886d9", "bridge": "br-int", "label": "tempest-device-tagging-net1-692071636", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa460343c-e0", "ovs_interfaceid": "a460343c-e064-4ea3-9fef-306db40e74d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "address": "fa:16:3e:e7:7d:28", "network": {"id": "f6666d92-e7b9-48a1-9994-2b9994e46099", "bridge": "br-int", "label": "tempest-device-tagging-net2-700609559", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e19f8fd7146d45069390beebe8dab168", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bdcacca-0d", "ovs_interfaceid": "8bdcacca-0de9-49f7-b11f-03fa3957e7b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-53616a5d-c619-4128-a4ab-9a77516d56b8 req-4a210920-84c0-4baf-b777-77c2113acae4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Detach interface failed, port_id=ce43e3fe-6244-47f7-a62d-5dcf19718f2e, reason: Instance c9099ee1-f916-4e61-ae3c-037b12780060 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:05:26 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:05:26 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Took 4.40 seconds to deallocate network for instance.
Aug 26 22:05:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYSyjbFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a', 'attached_at': '', 'detached_at': '', 'volume_id': '408489a8-82da-4480-ad5c-11dd3ed545cb', 'serial': '408489a8-82da-4480-ad5c-11dd3ed545cb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda2bf55-3dd4-49ef-a62d-f0b6a2770738', 'serial'} {{(pid=72929) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYSyjbFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:28 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:28 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:28 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36318fd-b0b9-44c6-9ded-5d3ae7bc3dd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:05:28 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2b5432-a912-4de0-9484-d0fd8aaa52f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb] added
Aug 26 22:05:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffb6971-441c-45a3-b623-dc15b61c4cbd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ec4bf1-61f5-43d7-92e6-daeab94a8e75]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYSyjbFm {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AYSyjbFm" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf857f3-65da-42f9-af21-bd032a34ce4e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AYSyjbFm'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-f93c8cb1-e6d9-4817-a074-265ac19e2235 req-99e381cd-4b2f-48c1-9e1c-14f97049f4d4 service nova] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Received event network-vif-deleted-8bdcacca-0de9-49f7-b11f-03fa3957e7b3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf45ce-26dd-4625-a452-56f5aa168f83]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ab0c40-c915-4068-85cc-ebf28c253463]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[625e52ec-490e-4efa-9d0c-01f7cfeadca3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260]
Aug 26 22:05:28 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[286d22e0-b689-4f84-9fbc-cb006d527450]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2f40b4-be76-4661-8809-cf4572acdf67]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:28 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[931b167e-0c21-47d7-8826-32259dd0b5b1]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYSyjbFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:05:28 user nova-compute[72929]: INFO nova.compute.manager [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Took 2.28 seconds to detach 3 volumes for instance.
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:29 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Deleted allocations for instance c9099ee1-f916-4e61-ae3c-037b12780060
Aug 26 22:05:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-731624d0-fd5f-4910-b467-65c427e368cf tempest-TaggedBootDevicesTest_v242-1916206492 tempest-TaggedBootDevicesTest_v242-1916206492-project-member] Lock "c9099ee1-f916-4e61-ae3c-037b12780060" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.139s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23966323361316665', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966323361316665', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lazy-loading 'flavor' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 311427072 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 491782144 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 679477248 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 1023410176 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:33 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3392c-52ac-463d-ba63-6a745113efae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b210ea3-6f8f-445c-bf99-500537fe55d9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:33 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:33 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:33 user nova-compute[72929]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:33 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803bcc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e17f2b-fa8d-4ebd-9a77-412e48a8ef62]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ced00-6ce1-4471-8772-11b8a5708eb9]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dce1a4-dda0-4857-8749-964a548f8dc7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.074s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb77c483-0d86-4d6b-bac3-1b5b4ca2ba06]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800d0d8-eb03-45dc-8c4e-ba6b3157af35]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fdec71-5b8e-4747-bcd3-918388b119a8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]
Aug 26 22:05:33 user nova-compute[72929]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ddd69-51e8-4c28-a30b-aa0a96a53b82]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] <== disconnect_volume: return (297ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYSyjbFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a', 'attached_at': '', 'detached_at': '', 'volume_id': '408489a8-82da-4480-ad5c-11dd3ed545cb', 'serial'} {{(pid=72929) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 22:05:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] swap_volume: removing Cinder connection for volume dda2bf55-3dd4-49ef-a62d-f0b6a2770738 {{(pid=72929) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 22:05:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] swap_volume: Updating volume dda2bf55-3dd4-49ef-a62d-f0b6a2770738 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "AYSyjbFm", "auth_password": "bfXkNiY4FDKM2R", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "408489a8-82da-4480-ad5c-11dd3ed545cb"}, "status": "reserved", "instance": "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a", "attached_at": "", "detached_at": "", "volume_id": "408489a8-82da-4480-ad5c-11dd3ed545cb", "serial": "408489a8-82da-4480-ad5c-11dd3ed545cb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '408489a8-82da-4480-ad5c-11dd3ed545cb', 'no_device': None, 'attachment_id': 'b2a64213-18e8-464a-8e98-36e291a60f14'} {{(pid=72929) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 22:05:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3e963fa-377c-427d-aa08-fc09fb1f4bc4 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.428s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087520.1413937, c9099ee1-f916-4e61-ae3c-037b12780060 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:05:35 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] VM Stopped (Lifecycle Event)
Aug 26 22:05:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0c3a456c-3a35-4725-801d-2a2e6b10fea2 None None] [instance: c9099ee1-f916-4e61-ae3c-037b12780060] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG os_brick.utils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c646426f-4686-4157-8b81-ca1c8be31a4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1eb62c-cceb-4f94-8581-e3d657b663e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae05e2d0-a21c-4f7f-966f-cae996841a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5209332-13c6-4f25-8bfc-53ff5d1a07f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:05:35 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:05:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7386f084-8dd5-4304-8c8a-c6d619e62a2b]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:05:35 user nova-compute[72929]: DEBUG os_brick.utils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:35 user nova-compute[72929]: INFO nova.compute.manager [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Swapping volume 408489a8-82da-4480-ad5c-11dd3ed545cb for dda2bf55-3dd4-49ef-a62d-f0b6a2770738
Aug 26 22:05:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda2bf55-3dd4-49ef-a62d-f0b6a2770738', 'serial': 'dda2bf55-3dd4-49ef-a62d-f0b6a2770738'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYSyjbFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '408489a8-82da-4480-ad5c-11dd3ed545cb'}, 'status': 'reserved', 'instance': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a', 'attached_at': '', 'detached_at': '', 'volume_id': '408489a8-82da-4480-ad5c-11dd3ed545cb', 'serial'} {{(pid=72929) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:46 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:46 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:46 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[665efc8c-1b0c-40cd-9159-dd73cd50f4ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:05:46 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d4575b-7fe9-4107-ac8f-094935c1a86d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738] added
Aug 26 22:05:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd543d-7896-41f3-97cd-6bffab0c86b0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a622538-adfa-492e-9a6b-3d761d9a45f5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKkDwFOo {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pKkDwFOo" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[416d608d-b58b-4737-80fb-a2601815b038]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pKkDwFOo'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c467ba-c5ea-46e7-be1d-ab2732982354]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a1fb4b-dd5a-48f1-878e-d2ce39f74efe]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:46 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:46 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2e84ac-7eda-4a91-8d1f-7e4bf0a5208e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]
Aug 26 22:05:46 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e30e76-0a19-44ed-b1c1-67c45c22fdb4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[79829aa7-29fc-4e2b-b427-246fe515e8db]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:46 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:46 user nova-compute[72929]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:46 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:46 user nova-compute[72929]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ab21c-52b2-418a-8dc9-bcc0c876813e]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:46 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23230643130383266', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230643130383266', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG nova.objects.instance [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lazy-loading 'flavor' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 511705088 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 660602880 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 827326464 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 1008730112 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AYSyjbFm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '408489a8-82da-4480-ad5c-11dd3ed545cb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:51 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dfc592-a416-4ddf-bea0-08d545cd1563]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[114acbf8-23af-4440-a958-ca4955be67e7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:51 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:51 user nova-compute[72929]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:51 user nova-compute[72929]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb (non-flash)
Aug 26 22:05:51 user nova-compute[72929]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803dab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e7c594-2494-470f-8462-85efb3811452]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbefdb58-0cbd-4fd0-b4b4-9794a003e5cd]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6fab4c-e8c6-4e19-a75e-45f04f75612c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13d766c-1ff4-46b6-be5c-1906ea8428bd]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf28d371-2cd0-433e-8531-c55cd901a490]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f960c-363c-47d6-a25a-224ca526f4c0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260]
Aug 26 22:05:52 user nova-compute[72929]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:52 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:408489a8-82da-4480-ad5c-11dd3ed545cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd677a4-efd4-47f8-8de4-aa09f6bb13e2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] <== disconnect_volume: return (280ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '0babcaa6-ae8f-46bb-b265-67b5fe76cf1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'dda2bf55-3dd4-49ef-a62d-f0b6a2770738', 'serial'} {{(pid=72929) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] swap_volume: removing Cinder connection for volume 408489a8-82da-4480-ad5c-11dd3ed545cb {{(pid=72929) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] swap_volume: Updating volume 408489a8-82da-4480-ad5c-11dd3ed545cb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "pKkDwFOo", "auth_password": "XkIlzueb8FxO2M", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "dda2bf55-3dd4-49ef-a62d-f0b6a2770738"}, "status": "reserved", "instance": "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a", "attached_at": "", "detached_at": "", "volume_id": "dda2bf55-3dd4-49ef-a62d-f0b6a2770738", "serial": "dda2bf55-3dd4-49ef-a62d-f0b6a2770738"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'dda2bf55-3dd4-49ef-a62d-f0b6a2770738', 'no_device': None, 'attachment_id': 'c58e7367-ed89-47d3-a348-58cf4ffb590e'} {{(pid=72929) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 26 22:05:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-35768c97-70e3-43bb-846d-a6dfc2e388e9 tempest-TestVolumeSwap-454030604 tempest-TestVolumeSwap-454030604-project-admin] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.467s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:54 user nova-compute[72929]: INFO nova.compute.manager [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Detaching volume dda2bf55-3dd4-49ef-a62d-f0b6a2770738
Aug 26 22:05:54 user nova-compute[72929]: INFO nova.virt.block_device [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Attempting to driver detach volume dda2bf55-3dd4-49ef-a62d-f0b6a2770738 from mountpoint /dev/vdb
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Attempting to detach device vdb from instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:05:54 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:05:54 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:05:54 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:05:54 user nova-compute[72929]:   <serial>dda2bf55-3dd4-49ef-a62d-f0b6a2770738</serial>
Aug 26 22:05:54 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:05:54 user nova-compute[72929]: </disk>
Aug 26 22:05:54 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:05:54 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Successfully detached device vdb from instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a from the persistent domain config.
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:05:54 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:05:54 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:05:54 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:05:54 user nova-compute[72929]:   <serial>dda2bf55-3dd4-49ef-a62d-f0b6a2770738</serial>
Aug 26 22:05:54 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:05:54 user nova-compute[72929]: </disk>
Aug 26 22:05:54 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087554.5870283, 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:05:54 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Successfully detached device vdb from instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a from the live domain config.
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pKkDwFOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'dda2bf55-3dd4-49ef-a62d-f0b6a2770738'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:54 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c450c7-e913-4452-9f8d-9d27f65ca04f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e4a99c-6b2e-4a98-871a-d58a5cbf4031]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:54 user nova-compute[72929]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:05:54 user nova-compute[72929]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 (non-flash)
Aug 26 22:05:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba01b8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a1d90-7ff6-4c8e-ae55-ea0ee85ee51c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aba9ae7-b29d-4451-b8f8-d81b2cd2e172]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abd7b81-4cae-41b7-9ed6-0e52255b6caa]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ada84-b04c-41d0-a57a-781b7af0b80e]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80eb402-20f2-45b5-9b40-9b7b7e16a2ec]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b9fadc-75a1-42d9-92a3-2614cb238689]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260]
Aug 26 22:05:54 user nova-compute[72929]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738, portal: 172.16.0.220,3260] successful.
Aug 26 22:05:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dda2bf55-3dd4-49ef-a62d-f0b6a2770738 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[572904dc-a2f0-4c73-86b9-8a2c4fe0a373]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] <== disconnect_volume: return (261ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:05:55 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lazy-loading 'flavor' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5060335a-5b4e-40ed-b790-9f5fa5424404 tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG nova.objects.instance [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:05:59 user nova-compute[72929]: INFO nova.compute.manager [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attaching volume ac70eee3-167e-45c8-b07b-a7974bcb75f6 to /dev/vdb
Aug 26 22:05:59 user nova-compute[72929]: DEBUG os_brick.utils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f60756-ca0b-441b-8ce0-224fe33c3ba9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97e16cd-59a8-41e4-9ff8-d6a1160ac344]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[076e7512-408c-446f-8c73-be94e09087ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7300b6-a8dd-45d8-b8fd-ed6558e98a16]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:05:59 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:05:59 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[db13a431-6d87-4ccb-b42d-bc37506a6ba8]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG os_brick.utils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:05:59 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating existing volume attachment record: 7fd28fdd-155e-4aa2-bb36-edcd6d96133b {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:06:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:06:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:06:01 user nova-compute[72929]: INFO nova.compute.claims [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Claim successful on node user
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:06:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.policy [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c2dac68027a44a09a4deadab28f2981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6d14fc09c246779e46e7c816370a1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:06:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Creating image(s)
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk 1073741824" returned: 0 in 0.057s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Successfully created port: 30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:06:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Cannot resize image /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Ensure instance console log exists: /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Successfully updated port: 30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing instance network info cache due to event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance network_info: |[{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.neutron [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Start _get_guest_xml network_info=[{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:06:04 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:04 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1899681647',display_name='tempest-ServerRescueNegativeTestJSON-server-1899681647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1899681647',id=24,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmrnsPl9BCUz5gKi6NIGGc/WZfHCJpUkxNKj7/Gj13IimJduOfPMx5AAuMDtl6q2lQ2zDF7GwrYVa9bqba/vCby+DzGKrrDrrGXRxVHtS7xxJn2R2FxVmPEdZ2aAIFi5g==',key_name='tempest-keypair-1557050715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-gj6izi2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c2dac68027a44a09a4deadab28f2981',uuid=f16261bd-823d-4d47-9f2e-f33c0c03cfdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'pci_devices' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:06:04 user nova-compute[72929]:   <uuid>f16261bd-823d-4d47-9f2e-f33c0c03cfdf</uuid>
Aug 26 22:06:04 user nova-compute[72929]:   <name>instance-00000018</name>
Aug 26 22:06:04 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:06:04 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:06:04 user nova-compute[72929]:   <metadata>
Aug 26 22:06:04 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:06:04 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:06:04 user nova-compute[72929]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1899681647</nova:name>
Aug 26 22:06:04 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:06:04</nova:creationTime>
Aug 26 22:06:04 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:06:04 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:06:04 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:06:04 user nova-compute[72929]:       <nova:owner>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:user uuid="6c2dac68027a44a09a4deadab28f2981">tempest-ServerRescueNegativeTestJSON-26026282-project-member</nova:user>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:project uuid="4e6d14fc09c246779e46e7c816370a1c">tempest-ServerRescueNegativeTestJSON-26026282</nova:project>
Aug 26 22:06:04 user nova-compute[72929]:       </nova:owner>
Aug 26 22:06:04 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:06:04 user nova-compute[72929]:       <nova:ports>
Aug 26 22:06:04 user nova-compute[72929]:         <nova:port uuid="30fff5ce-e634-4d69-bba7-e77ac1190ee2">
Aug 26 22:06:04 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 22:06:04 user nova-compute[72929]:         </nova:port>
Aug 26 22:06:04 user nova-compute[72929]:       </nova:ports>
Aug 26 22:06:04 user nova-compute[72929]:     </nova:instance>
Aug 26 22:06:04 user nova-compute[72929]:   </metadata>
Aug 26 22:06:04 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:06:04 user nova-compute[72929]:     <system>
Aug 26 22:06:04 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:06:04 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:06:04 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:06:04 user nova-compute[72929]:       <entry name="serial">f16261bd-823d-4d47-9f2e-f33c0c03cfdf</entry>
Aug 26 22:06:04 user nova-compute[72929]:       <entry name="uuid">f16261bd-823d-4d47-9f2e-f33c0c03cfdf</entry>
Aug 26 22:06:04 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:06:04 user nova-compute[72929]:     </system>
Aug 26 22:06:04 user nova-compute[72929]:   </sysinfo>
Aug 26 22:06:04 user nova-compute[72929]:   <os>
Aug 26 22:06:04 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:06:04 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:06:04 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:06:04 user nova-compute[72929]:   </os>
Aug 26 22:06:04 user nova-compute[72929]:   <features>
Aug 26 22:06:04 user nova-compute[72929]:     <acpi/>
Aug 26 22:06:04 user nova-compute[72929]:     <apic/>
Aug 26 22:06:04 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:06:04 user nova-compute[72929]:   </features>
Aug 26 22:06:04 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:06:04 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:06:04 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:06:04 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:06:04 user nova-compute[72929]:   </clock>
Aug 26 22:06:04 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:06:04 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:06:04 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:06:04 user nova-compute[72929]:   </cpu>
Aug 26 22:06:04 user nova-compute[72929]:   <devices>
Aug 26 22:06:04 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:06:04 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:06:04 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk"/>
Aug 26 22:06:04 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:06:04 user nova-compute[72929]:     </disk>
Aug 26 22:06:04 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:06:04 user nova-compute[72929]:       <mac address="fa:16:3e:72:b9:27"/>
Aug 26 22:06:04 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:06:04 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:06:04 user nova-compute[72929]:       <target dev="tap30fff5ce-e6"/>
Aug 26 22:06:04 user nova-compute[72929]:     </interface>
Aug 26 22:06:04 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:06:04 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/console.log" append="off"/>
Aug 26 22:06:04 user nova-compute[72929]:     </serial>
Aug 26 22:06:04 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:06:04 user nova-compute[72929]:     <video>
Aug 26 22:06:04 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:06:04 user nova-compute[72929]:     </video>
Aug 26 22:06:04 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:06:04 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:06:04 user nova-compute[72929]:     </rng>
Aug 26 22:06:04 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:06:04 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:06:04 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:06:04 user nova-compute[72929]:     </memballoon>
Aug 26 22:06:04 user nova-compute[72929]:   </devices>
Aug 26 22:06:04 user nova-compute[72929]: </domain>
Aug 26 22:06:04 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1899681647',display_name='tempest-ServerRescueNegativeTestJSON-server-1899681647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1899681647',id=24,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmrnsPl9BCUz5gKi6NIGGc/WZfHCJpUkxNKj7/Gj13IimJduOfPMx5AAuMDtl6q2lQ2zDF7GwrYVa9bqba/vCby+DzGKrrDrrGXRxVHtS7xxJn2R2FxVmPEdZ2aAIFi5g==',key_name='tempest-keypair-1557050715',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-gj6izi2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c2dac68027a44a09a4deadab28f2981',uuid=f16261bd-823d-4d47-9f2e-f33c0c03cfdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG os_vif [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fff5ce-e6, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30fff5ce-e6, col_values=(('external_ids', {'iface-id': '30fff5ce-e634-4d69-bba7-e77ac1190ee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:b9:27', 'vm-uuid': 'f16261bd-823d-4d47-9f2e-f33c0c03cfdf'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:04 user nova-compute[72929]: INFO os_vif [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6')
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:72:b9:27, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.neutron [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updated VIF entry in instance network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG nova.network.neutron [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-89572a5a-dad8-49b0-809f-11cac1b9f951 req-4a8b9318-a554-4efc-9f25-5dd089db8ecb service nova] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received event network-changed-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Refreshing instance network info cache due to event network-changed-99b17457-c0da-41f5-a632-9aeffe501810. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] Acquiring lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] Acquired lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG nova.network.neutron [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Refreshing network info cache for port 99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-06f7c02f-7151-4c74-85ff-de128a9797c9 req-32c9f782-66ed-4b85-8d4c-dc303cf4c9a0 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-06f7c02f-7151-4c74-85ff-de128a9797c9 req-32c9f782-66ed-4b85-8d4c-dc303cf4c9a0 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-06f7c02f-7151-4c74-85ff-de128a9797c9 req-32c9f782-66ed-4b85-8d4c-dc303cf4c9a0 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-06f7c02f-7151-4c74-85ff-de128a9797c9 req-32c9f782-66ed-4b85-8d4c-dc303cf4c9a0 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-06f7c02f-7151-4c74-85ff-de128a9797c9 req-32c9f782-66ed-4b85-8d4c-dc303cf4c9a0 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:06 user nova-compute[72929]: WARNING nova.compute.manager [req-06f7c02f-7151-4c74-85ff-de128a9797c9 req-32c9f782-66ed-4b85-8d4c-dc303cf4c9a0 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state building and task_state spawning.
Aug 26 22:06:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updated VIF entry in instance network info cache for port 99b17457-c0da-41f5-a632-9aeffe501810. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updating instance_info_cache with network_info: [{"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6559227d-256c-4cc7-adb8-2a75eab73c07 req-ab349c2f-3bc8-4507-a34e-25ba0e6f388e service nova] Releasing lock "refresh_cache-63d06f04-417d-4f92-bf7c-d4809e518d2a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087568.0326948, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Resumed (Lifecycle Event)
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance spawned successfully.
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087568.0328789, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Started (Lifecycle Event)
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:08 user nova-compute[72929]: INFO nova.compute.manager [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Took 6.59 seconds to build instance.
Aug 26 22:06:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9e0dd0eb-56b0-4f62-afb7-4e99ec0e2934 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.690s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-ab410125-0972-495d-b76e-3b705caafb31 req-10a81829-bd33-42c0-9c0a-a64cc372ad84 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab410125-0972-495d-b76e-3b705caafb31 req-10a81829-bd33-42c0-9c0a-a64cc372ad84 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab410125-0972-495d-b76e-3b705caafb31 req-10a81829-bd33-42c0-9c0a-a64cc372ad84 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab410125-0972-495d-b76e-3b705caafb31 req-10a81829-bd33-42c0-9c0a-a64cc372ad84 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-ab410125-0972-495d-b76e-3b705caafb31 req-10a81829-bd33-42c0-9c0a-a64cc372ad84 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:08 user nova-compute[72929]: WARNING nova.compute.manager [req-ab410125-0972-495d-b76e-3b705caafb31 req-10a81829-bd33-42c0-9c0a-a64cc372ad84 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state active and task_state None.
Aug 26 22:06:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid 63d06f04-417d-4f92-bf7c-d4809e518d2a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:10 user nova-compute[72929]: INFO nova.compute.manager [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Attaching volume 857b7e0a-5576-43e4-8cc0-dc2cc67257b0 to /dev/vdb
Aug 26 22:06:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgfkMqhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:10 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:10 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:10 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.utils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436b31d-67ee-40fc-93ad-7bc3f6580c94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:06:10 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc553a08-5646-4b55-879c-87e83fe5af3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[095834d0-3a5d-4d64-a9a4-69e1d32452cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6] added
Aug 26 22:06:10 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[061a66c3-64f0-4c0d-8acd-49c3d955ef8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7a7410-aaa9-4bd5-a336-515cceaed4de]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d95c69d-afba-4124-b311-019c628fe9e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d59fd7a-4019-4af6-9c81-5a2112f9e23c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4740c61a-ae19-468a-bea6-9f8f8e4fb688]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tgfkMqhr {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:06:10 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8cab6f-ca54-4636-8ab3-2cee40843eff]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tgfkMqhr" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34f9fc-1e58-497b-b00e-0ca07a78de1d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tgfkMqhr'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.utils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updating existing volume attachment record: 317eaade-18e3-4576-9eca-44e27f1e5e2e {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb7671-d175-4474-9ce0-8796fbda9470]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe52c66-0a68-4220-b638-2daf9774ad95]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:10 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:10 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea91993-3aec-425a-8ed6-7a4cfce4ef2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260]
Aug 26 22:06:11 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a703ce1a-daea-488e-8bab-2e865034aadd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd95a7ca-fd8f-4dca-aea9-a4981bdb6673]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:11 user nova-compute[72929]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 (non-flash)
Aug 26 22:06:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:11 user nova-compute[72929]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 (non-flash)
Aug 26 22:06:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d9a1f-e34e-482d-818f-6ef539411e39]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgfkMqhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:06:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23362363930303235', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362363930303235', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG nova.objects.instance [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:06:12 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:12 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:12 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:12 user nova-compute[72929]:   <serial>ac70eee3-167e-45c8-b07b-a7974bcb75f6</serial>
Aug 26 22:06:12 user nova-compute[72929]: </disk>
Aug 26 22:06:12 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No VIF found with MAC fa:16:3e:d1:91:3e, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-395c379f-ef81-4069-b186-abcad48301e9 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.417s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:15 user nova-compute[72929]: INFO nova.compute.manager [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Detaching volume ac70eee3-167e-45c8-b07b-a7974bcb75f6
Aug 26 22:06:15 user nova-compute[72929]: INFO nova.virt.block_device [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attempting to driver detach volume ac70eee3-167e-45c8-b07b-a7974bcb75f6 from mountpoint /dev/vdb
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Attempting to detach device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:06:15 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:15 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:15 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:15 user nova-compute[72929]:   <serial>ac70eee3-167e-45c8-b07b-a7974bcb75f6</serial>
Aug 26 22:06:15 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:06:15 user nova-compute[72929]: </disk>
Aug 26 22:06:15 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:06:15 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully detached device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the persistent domain config.
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:06:15 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:15 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:15 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:15 user nova-compute[72929]:   <serial>ac70eee3-167e-45c8-b07b-a7974bcb75f6</serial>
Aug 26 22:06:15 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:06:15 user nova-compute[72929]: </disk>
Aug 26 22:06:15 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087575.5769298, 3db3d467-df63-4ea0-951b-4eee4460980f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:06:15 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully detached device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the live domain config.
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tgfkMqhr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:15 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5e9b4f-d58b-4121-bee1-75fed83e1bc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cfae53-0b93-49c5-8a07-c255aa1f8f03]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:15 user nova-compute[72929]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 (non-flash)
Aug 26 22:06:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:15 user nova-compute[72929]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 (non-flash)
Aug 26 22:06:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8017dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b27c5ab-94cb-4fab-9784-f5e31a59d6d3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a71d9b4-ff5a-42ac-a0c4-60ee2833c58e]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a59bfd-9d2b-462f-87e7-bb8976f5f35b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116a8bc-3877-4fdf-a088-ea5709dd7fd7]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e964008b-babf-4a45-9f52-eadfbf114170]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f8eb8e-36c6-4591-9064-84b6dd545ed2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260]
Aug 26 22:06:15 user nova-compute[72929]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:15 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac70eee3-167e-45c8-b07b-a7974bcb75f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[57362907-d1b7-4b2d-b567-948730cbf9b4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== disconnect_volume: return (268ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:06:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cc5cac6d-a6c3-4d7f-ae83-189a82d9dfbe tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:17 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:18 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updating instance_info_cache with network_info: [{"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-2f582511-ae2c-47e3-aa26-86e173891e56" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnXmWRKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:22 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:22 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:22 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a0943-a70e-49ef-9477-9099b9f37e63]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:06:22 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c99a0cd-10a7-4663-84e1-b4ce027510b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0] added
Aug 26 22:06:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd041f-f009-46b5-a662-822ebf73439d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a9b36-6343-4816-9f08-1590c34a87c0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SnXmWRKx {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SnXmWRKx" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d2d2e-a4f3-4359-ac47-ee128ed424cf]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SnXmWRKx'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[55386642-dd99-442e-8a5a-773f2524f9c0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc6896-d2f5-4226-9270-d9c470fc0a1d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f81ed-1fd0-4fa9-9c81-03926ed1dbac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260]
Aug 26 22:06:22 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a954b4b-869c-41fc-b547-aa1d7ea9b801]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d26707-46d9-4d49-8ad1-33c1b6b6f586]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:22 user nova-compute[72929]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 (non-flash)
Aug 26 22:06:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:22 user nova-compute[72929]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 (non-flash)
Aug 26 22:06:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4004f0d4-8818-4fe6-8a63-c73944b1ea90]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnXmWRKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23030653632323639', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030653632323639', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid 63d06f04-417d-4f92-bf7c-d4809e518d2a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:06:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:23 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:23 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:23 user nova-compute[72929]:   <serial>857b7e0a-5576-43e4-8cc0-dc2cc67257b0</serial>
Aug 26 22:06:23 user nova-compute[72929]: </disk>
Aug 26 22:06:23 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:b7:46:0a, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8596c719-431b-4f34-948a-6f860f839e78 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.534s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:25 user nova-compute[72929]: INFO nova.compute.manager [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Detaching volume 857b7e0a-5576-43e4-8cc0-dc2cc67257b0
Aug 26 22:06:25 user nova-compute[72929]: INFO nova.virt.block_device [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Attempting to driver detach volume 857b7e0a-5576-43e4-8cc0-dc2cc67257b0 from mountpoint /dev/vdb
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Attempting to detach device vdb from instance 63d06f04-417d-4f92-bf7c-d4809e518d2a from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:06:25 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:25 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:25 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:25 user nova-compute[72929]:   <serial>857b7e0a-5576-43e4-8cc0-dc2cc67257b0</serial>
Aug 26 22:06:25 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:06:25 user nova-compute[72929]: </disk>
Aug 26 22:06:25 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:06:25 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully detached device vdb from instance 63d06f04-417d-4f92-bf7c-d4809e518d2a from the persistent domain config.
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63d06f04-417d-4f92-bf7c-d4809e518d2a from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:06:25 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:25 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:25 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:25 user nova-compute[72929]:   <serial>857b7e0a-5576-43e4-8cc0-dc2cc67257b0</serial>
Aug 26 22:06:25 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:06:25 user nova-compute[72929]: </disk>
Aug 26 22:06:25 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087585.7309573, 63d06f04-417d-4f92-bf7c-d4809e518d2a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63d06f04-417d-4f92-bf7c-d4809e518d2a {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:06:25 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully detached device vdb from instance 63d06f04-417d-4f92-bf7c-d4809e518d2a from the live domain config.
Aug 26 22:06:25 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:25 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=24.315677642822266GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnXmWRKx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:25 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34be65a-b05b-463d-8272-b34fab966dc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772284e-4afb-4d8f-aed4-29b1198ce0ce]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:25 user nova-compute[72929]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 (non-flash)
Aug 26 22:06:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:25 user nova-compute[72929]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 (non-flash)
Aug 26 22:06:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b982edea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd9426d-b3f6-4d4c-9426-b966a47f5f29]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b93fe-db95-4b70-8668-b2391e8dd1be]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:06:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecf6cbc-69d9-4f9e-aa44-423f06261586]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8555f690-3843-4989-8d93-2bf3ce87e8ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 63d06f04-417d-4f92-bf7c-d4809e518d2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 387ba104-895e-433c-a100-51b98acf8c15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b4157a-a949-4965-a6e3-b7c7636c7b43]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71af275-8fa8-4a2a-b1fe-9bb3e8899069]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c517ab-8bfc-457b-9209-196e8dce1e13]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260]
Aug 26 22:06:26 user nova-compute[72929]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:857b7e0a-5576-43e4-8cc0-dc2cc67257b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3426dc43-9d2d-4aac-a00a-862a261590f3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== disconnect_volume: return (315ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG nova.objects.instance [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid 63d06f04-417d-4f92-bf7c-d4809e518d2a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-49f42538-e1aa-47ab-9f43-3e8315c8a8b0 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.851s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-changed-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Refreshing instance network info cache due to event network-changed-b77cb74f-4900-4123-9977-e70738850ef2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] Acquiring lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] Acquired lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Refreshing network info cache for port b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'flavor' on Instance uuid ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updated VIF entry in instance network info cache for port b77cb74f-4900-4123-9977-e70738850ef2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updating instance_info_cache with network_info: [{"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b5638e82-de01-4b58-acb3-630b4e52c037 req-2cc90bd6-c405-475b-b658-c4c24688e704 service nova] Releasing lock "refresh_cache-ca93842d-f13f-4b73-8e2e-06da55cdc8bc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.007s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:29 user nova-compute[72929]: INFO nova.compute.manager [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attaching volume 58f3a0bd-366b-4049-99eb-91a01af282ff to /dev/vdb
Aug 26 22:06:29 user nova-compute[72929]: DEBUG os_brick.utils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8207429-ceff-48a6-8afd-1a2fea74ba42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f49f49-8184-4a4f-91ae-5a985810e8db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e5a28-0905-4126-b755-b94bd4a37926]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[985deeed-72f1-4dfb-a424-0ea23d82af83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:06:29 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:06:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[844e33e9-0000-40e3-851b-2f5ba858181f]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG os_brick.utils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:29 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updating existing volume attachment record: f2a79d16-c653-49cd-845e-b26f2af8024e {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:06:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:40 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:40 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:40 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b6cc7d-93c2-4ccf-86f3-61f28c22dc31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:06:40 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fe637b-b0d3-4dc7-b91d-fdf61897b29b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff] added
Aug 26 22:06:40 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c836ef-d477-4127-a33d-f8457b865fd7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4827bc6-3f2d-414d-b00e-2fb3bcff6540]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdEcZXSi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdEcZXSi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ed563-3fe8-46ed-bb5b-c8a484e74600]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GdEcZXSi'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[659a0f61-07c8-44e4-81d6-f9f3cc0cb49b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[187070b4-408f-44d9-916f-1a4e7abf18fa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5110965-99a2-434f-89c0-bba0762cf706]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]
Aug 26 22:06:41 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426df00-18bb-4fd4-8a5b-3385393753b4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5d971f-f2dd-4be1-9683-b426267ae1af]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:41 user nova-compute[72929]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:06:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:41 user nova-compute[72929]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:06:41 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4db93-5d26-4e78-950a-aea740a9c4f0]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23438646130636461', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438646130636461', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'flavor' on Instance uuid ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:06:42 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:42 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:42 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:42 user nova-compute[72929]:   <serial>58f3a0bd-366b-4049-99eb-91a01af282ff</serial>
Aug 26 22:06:42 user nova-compute[72929]: </disk>
Aug 26 22:06:42 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No VIF found with MAC fa:16:3e:d4:08:ee, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72488f2e-89b5-43a1-a723-a3b521e1a617 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.019s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:44 user nova-compute[72929]: INFO nova.compute.manager [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Terminating instance
Aug 26 22:06:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:06:44 user nova-compute[72929]: INFO nova.compute.manager [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Rebuilding instance
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-77003ec2-3829-4dd7-bf53-d0c78270e1c0 req-01e946e6-5049-4bcd-9985-fff117be57a8 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-vif-unplugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-77003ec2-3829-4dd7-bf53-d0c78270e1c0 req-01e946e6-5049-4bcd-9985-fff117be57a8 service nova] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-77003ec2-3829-4dd7-bf53-d0c78270e1c0 req-01e946e6-5049-4bcd-9985-fff117be57a8 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-77003ec2-3829-4dd7-bf53-d0c78270e1c0 req-01e946e6-5049-4bcd-9985-fff117be57a8 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-77003ec2-3829-4dd7-bf53-d0c78270e1c0 req-01e946e6-5049-4bcd-9985-fff117be57a8 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] No waiting events found dispatching network-vif-unplugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-77003ec2-3829-4dd7-bf53-d0c78270e1c0 req-01e946e6-5049-4bcd-9985-fff117be57a8 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-vif-unplugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Instance destroyed successfully.
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.objects.instance [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lazy-loading 'resources' on Instance uuid 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-112589346',display_name='tempest-TestVolumeSwap-server-112589346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-112589346',id=18,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXpb9Nczvs7W/DODSdr1DSVqdGeXX8jEg1JoLgtAr2ucEOJ3nMVC5E00WzUTTy1xW/OtfNcEm2xQgQQ8NdngyuqxPmVL5zefMA5Ps8dSVRR0dorZusNe18dS+kGOe7Pig==',key_name='tempest-keypair-1888339583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78cea4ac85b64f0686c0b24380e77511',ramdisk_id='',reservation_id='r-gajabqva',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1933790878',owner_user_name='tempest-TestVolumeSwap-1933790878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f6523950553a47558f00bcad92c2e8b5',uuid=0babcaa6-ae8f-46bb-b265-67b5fe76cf1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Converting VIF {"id": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "address": "fa:16:3e:7c:a4:99", "network": {"id": "c4d97006-2b72-4ea3-aacf-92a71a32c9a5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1321152850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "78cea4ac85b64f0686c0b24380e77511", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0af43a8-69", "ovs_interfaceid": "a0af43a8-699d-42b1-9621-0eb0e934ce29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_vif [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0af43a8-69, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance destroyed successfully.
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:45 user nova-compute[72929]: INFO os_vif [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a4:99,bridge_name='br-int',has_traffic_filtering=True,id=a0af43a8-699d-42b1-9621-0eb0e934ce29,network=Network(c4d97006-2b72-4ea3-aacf-92a71a32c9a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0af43a8-69')
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Deleting instance files /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a_del
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Deletion of /opt/stack/data/nova/instances/0babcaa6-ae8f-46bb-b265-67b5fe76cf1a_del complete
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.compute.manager [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.compute.manager [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Detaching volume 58f3a0bd-366b-4049-99eb-91a01af282ff
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.virt.block_device [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attempting to driver detach volume 58f3a0bd-366b-4049-99eb-91a01af282ff from mountpoint /dev/vdb
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Attempting to detach device vdb from instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:06:45 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:45 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:06:45 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:06:45 user nova-compute[72929]:   <serial>58f3a0bd-366b-4049-99eb-91a01af282ff</serial>
Aug 26 22:06:45 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:06:45 user nova-compute[72929]: </disk>
Aug 26 22:06:45 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:06:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully detached device vdb from instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc from the persistent domain config.
Aug 26 22:06:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:45 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[77738121-72b7-4cc4-931d-c980b8364088]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b3c9e-1c87-4bea-adea-2a52ee0338e6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:45 user nova-compute[72929]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:06:45 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:45 user nova-compute[72929]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:06:45 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba6905750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73451c3-dfde-4b16-b100-9a9f17950837]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a351d-d80d-4f0e-8b21-6bc5c15ab574]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25517c6-c404-4c08-a2ba-0ac3613656a7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1dfbbd-8b63-4a19-9f9f-efd1a5d1dbc8]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[193e52fe-2f5e-489f-8283-9fc907e0c4bf]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0436af40-87f5-4329-8b92-72c58dbb76c3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]
Aug 26 22:06:46 user nova-compute[72929]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:46 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5d3f53-42a9-41c7-a3bb-162ba420e5bc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== disconnect_volume: return (279ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:46 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Took 0.81 seconds to deallocate network for instance.
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquired lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'info_cache' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Acquiring lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] No waiting events found dispatching network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:46 user nova-compute[72929]: WARNING nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received unexpected event network-vif-plugged-a0af43a8-699d-42b1-9621-0eb0e934ce29 for instance with vm_state deleted and task_state None.
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-unplugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-unplugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:46 user nova-compute[72929]: WARNING nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-unplugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state active and task_state rebuilding.
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:46 user nova-compute[72929]: WARNING nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state active and task_state rebuilding.
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-adf3dcd2-8b6c-423d-af09-5d472590565f req-1fe1f3b3-84bc-4629-9837-59c77cefeca7 service nova] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Received event network-vif-deleted-a0af43a8-699d-42b1-9621-0eb0e934ce29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance destroyed successfully.
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-979185243',display_name='tempest-ServerActionsTestOtherA-server-344031741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-979185243',id=21,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDr7ycWbe4a18QCutvpkP7CWIG7sFeN9yLq+Fk/+9la9FZ2+WrmjN1SrIaq9M5vapNsgXhY/fqJ+zVC2xw49y0ephiZ/bKzdZoGG4k3f4lcfIHaaq0HpH7+wgK2/e4Lsg==',key_name='tempest-keypair-1072437854',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-8pqov304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=ca93842d-f13f-4b73-8e2e-06da55cdc8bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb77cb74f-49, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:06:46 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Deleted allocations for instance 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a
Aug 26 22:06:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:46 user nova-compute[72929]: INFO os_vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49')
Aug 26 22:06:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:46 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77b9911-4345-4163-bb29-9b6c6d388149]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aed7d6-dda0-493b-b24d-84464e5d80df]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804d4790>, {}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Disconnecting from: [] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.043s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== disconnect_volume: return (45ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:06:47 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Deleting instance files /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc_del
Aug 26 22:06:47 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Deletion of /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc_del complete
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ced8b091-16ba-4c7c-93ba-5c06570edd8d tempest-TestVolumeSwap-1933790878 tempest-TestVolumeSwap-1933790878-project-member] Lock "0babcaa6-ae8f-46bb-b265-67b5fe76cf1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:47 user nova-compute[72929]: INFO nova.virt.block_device [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Booting with volume 58f3a0bd-366b-4049-99eb-91a01af282ff at /dev/vdb
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.network.neutron [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Releasing lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.utils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc1b67-1c92-4e47-a75f-884c66f603b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance destroyed successfully.
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'resources' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc011a-c523-41da-bef9-c8bd011a946e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a501758-13, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:06:47 user nova-compute[72929]: INFO os_vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13')
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:47 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[69271c40-cfc3-4622-923f-16f7f5c55a72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b6207b-c011-4985-8ef1-b636129d3c09]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a02bde2-8b01-43e8-b325-10a1d1b1ee87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:06:47 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0c3474-9556-4b27-b582-021eecbbef6a]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.utils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updating existing volume attachment record: 9e34bf3b-c41d-4571-a735-24e938d7b979 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2d97b4-ec73-4ec9-b354-634eba4e92d9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b98129fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'): ({'sdf'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Removing single pathed devices sdf {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2a3418-4172-4619-b0b6-50cc4b066ab1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e613b-77fb-42c7-8a99-002c5496ca48]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flushing IO for device /dev/sdf {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[563f7963-e06c-4a2f-bc4d-8c574fdd9a76]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ee8a8e-2740-48bb-891a-cec2fb295e13]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3233fa0e-79e1-4c50-88c5-4d82e344e06c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f7392-495d-412e-a2c8-ed81c8cc92cd]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]
Aug 26 22:06:47 user nova-compute[72929]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc924738-3020-45a0-957c-37741edbefbc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== disconnect_volume: return (291ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start _get_guest_xml network_info=[{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '007a6edf-d43d-43cf-b897-1e0e4fefa67b', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a0172f33-06bb-404d-8fb0-c88927e84bdd', 'attached_at': '', 'detached_at': '', 'volume_id': '16a42b1a-1527-46b4-9e96-3c16f6c0c981', 'serial': '16a42b1a-1527-46b4-9e96-3c16f6c0c981'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'numa_topology' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:06:47 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:47 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:06:47 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc699eb4-4e09-4aa4-8dc5-136d78c69bd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:06:47 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7d5c8d-b3f2-4cc0-b449-870f46384bec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981] added
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76c5c9f-1128-4ec9-bc4a-9775a9e80e92]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d265c0-92d8-4302-801e-98e1ced48454]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBMpaOGc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBMpaOGc" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce963287-4d04-481d-9941-689b1b5cd655]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBMpaOGc'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc87ac3-e5b6-4257-acfa-680f914478f8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e59ed-13b2-43a6-8939-a302e75108ae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 22:06:47 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 22:06:47 user nova-compute[72929]:  {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:47 user nova-compute[72929]: WARNING os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 22:06:47 user nova-compute[72929]: 
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace48ae0-4c05-4eaf-8fc4-6b2b60085c7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]
Aug 26 22:06:47 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b91795-0277-434b-ace5-43e6a808ef17]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a61c05-47dd-4d6a-9889-49eaee989c00]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:06:47 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4c06bd-1e2c-4d48-bc50-19b85ad5a7c7]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:06:47 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23961636165366161', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961636165366161', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'pci_devices' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:48 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:06:49 user nova-compute[72929]:   <uuid>a0172f33-06bb-404d-8fb0-c88927e84bdd</uuid>
Aug 26 22:06:49 user nova-compute[72929]:   <name>instance-00000011</name>
Aug 26 22:06:49 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:06:49 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:06:49 user nova-compute[72929]:   <metadata>
Aug 26 22:06:49 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:06:49 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:06:49 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeTestJSON-server-669557141</nova:name>
Aug 26 22:06:49 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:06:47</nova:creationTime>
Aug 26 22:06:49 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:06:49 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:06:49 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:06:49 user nova-compute[72929]:       <nova:owner>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:user uuid="c8e8fa1fcb0b4fa5aac66bdeee20b647">tempest-AttachVolumeTestJSON-1023625544-project-member</nova:user>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:project uuid="675048d1f37047e1bb05a2619fac538f">tempest-AttachVolumeTestJSON-1023625544</nova:project>
Aug 26 22:06:49 user nova-compute[72929]:       </nova:owner>
Aug 26 22:06:49 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:06:49 user nova-compute[72929]:       <nova:ports>
Aug 26 22:06:49 user nova-compute[72929]:         <nova:port uuid="0a501758-13fe-41e5-b210-355d69b6e7b8">
Aug 26 22:06:49 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:06:49 user nova-compute[72929]:         </nova:port>
Aug 26 22:06:49 user nova-compute[72929]:       </nova:ports>
Aug 26 22:06:49 user nova-compute[72929]:     </nova:instance>
Aug 26 22:06:49 user nova-compute[72929]:   </metadata>
Aug 26 22:06:49 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:06:49 user nova-compute[72929]:     <system>
Aug 26 22:06:49 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:06:49 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:06:49 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:06:49 user nova-compute[72929]:       <entry name="serial">a0172f33-06bb-404d-8fb0-c88927e84bdd</entry>
Aug 26 22:06:49 user nova-compute[72929]:       <entry name="uuid">a0172f33-06bb-404d-8fb0-c88927e84bdd</entry>
Aug 26 22:06:49 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:06:49 user nova-compute[72929]:     </system>
Aug 26 22:06:49 user nova-compute[72929]:   </sysinfo>
Aug 26 22:06:49 user nova-compute[72929]:   <os>
Aug 26 22:06:49 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:06:49 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:06:49 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:06:49 user nova-compute[72929]:   </os>
Aug 26 22:06:49 user nova-compute[72929]:   <features>
Aug 26 22:06:49 user nova-compute[72929]:     <acpi/>
Aug 26 22:06:49 user nova-compute[72929]:     <apic/>
Aug 26 22:06:49 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:06:49 user nova-compute[72929]:   </features>
Aug 26 22:06:49 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:06:49 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:06:49 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:06:49 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:06:49 user nova-compute[72929]:   </clock>
Aug 26 22:06:49 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:06:49 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:06:49 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:06:49 user nova-compute[72929]:   </cpu>
Aug 26 22:06:49 user nova-compute[72929]:   <devices>
Aug 26 22:06:49 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:06:49 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:06:49 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk"/>
Aug 26 22:06:49 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:06:49 user nova-compute[72929]:     </disk>
Aug 26 22:06:49 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:06:49 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:06:49 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:06:49 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:06:49 user nova-compute[72929]:       <serial>16a42b1a-1527-46b4-9e96-3c16f6c0c981</serial>
Aug 26 22:06:49 user nova-compute[72929]:     </disk>
Aug 26 22:06:49 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:06:49 user nova-compute[72929]:       <mac address="fa:16:3e:e0:4c:2b"/>
Aug 26 22:06:49 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:06:49 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:06:49 user nova-compute[72929]:       <target dev="tap0a501758-13"/>
Aug 26 22:06:49 user nova-compute[72929]:     </interface>
Aug 26 22:06:49 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:06:49 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/console.log" append="off"/>
Aug 26 22:06:49 user nova-compute[72929]:     </serial>
Aug 26 22:06:49 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:06:49 user nova-compute[72929]:     <video>
Aug 26 22:06:49 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:06:49 user nova-compute[72929]:     </video>
Aug 26 22:06:49 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:06:49 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:06:49 user nova-compute[72929]:     </rng>
Aug 26 22:06:49 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:06:49 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:06:49 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:06:49 user nova-compute[72929]:     </memballoon>
Aug 26 22:06:49 user nova-compute[72929]:   </devices>
Aug 26 22:06:49 user nova-compute[72929]: </domain>
Aug 26 22:06:49 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Cannot resize image /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'migration_context' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.objects.base [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG os_vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a501758-13, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a501758-13, col_values=(('external_ids', {'iface-id': '0a501758-13fe-41e5-b210-355d69b6e7b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:4c:2b', 'vm-uuid': 'a0172f33-06bb-404d-8fb0-c88927e84bdd'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:06:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:49 user nova-compute[72929]: INFO os_vif [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13')
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-dc240842-29ab-4059-96c9-314b3c98b50b req-f1c88fe7-ddee-4c42-a1b3-f602644f1511 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dc240842-29ab-4059-96c9-314b3c98b50b req-f1c88fe7-ddee-4c42-a1b3-f602644f1511 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dc240842-29ab-4059-96c9-314b3c98b50b req-f1c88fe7-ddee-4c42-a1b3-f602644f1511 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dc240842-29ab-4059-96c9-314b3c98b50b req-f1c88fe7-ddee-4c42-a1b3-f602644f1511 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-dc240842-29ab-4059-96c9-314b3c98b50b req-f1c88fe7-ddee-4c42-a1b3-f602644f1511 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:51 user nova-compute[72929]: WARNING nova.compute.manager [req-dc240842-29ab-4059-96c9-314b3c98b50b req-f1c88fe7-ddee-4c42-a1b3-f602644f1511 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state stopped and task_state powering-on.
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:06:51 user nova-compute[72929]: INFO nova.compute.claims [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Claim successful on node user
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:06:52 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.policy [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c667638141d429e925ecd38af6423fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c177bf6e804c3292dab6eaf860934d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:06:52 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Creating image(s)
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "/opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "/opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk 1073741824" returned: 0 in 0.061s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Successfully created port: e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Cannot resize image /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Ensure instance console log exists: /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087613.6098888, a0172f33-06bb-404d-8fb0-c88927e84bdd => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:06:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Resumed (Lifecycle Event)
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:06:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance rebooted successfully.
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7b1b4351-b0d2-4f7a-9c41-2da8f3d201e2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:06:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087613.6118014, a0172f33-06bb-404d-8fb0-c88927e84bdd => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:06:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Started (Lifecycle Event)
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-ba11e62a-11e6-48be-ad3c-6d42ede8b876 req-9de13bbb-88cd-4762-bd4c-d2a923b0140b service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ba11e62a-11e6-48be-ad3c-6d42ede8b876 req-9de13bbb-88cd-4762-bd4c-d2a923b0140b service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ba11e62a-11e6-48be-ad3c-6d42ede8b876 req-9de13bbb-88cd-4762-bd4c-d2a923b0140b service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ba11e62a-11e6-48be-ad3c-6d42ede8b876 req-9de13bbb-88cd-4762-bd4c-d2a923b0140b service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-ba11e62a-11e6-48be-ad3c-6d42ede8b876 req-9de13bbb-88cd-4762-bd4c-d2a923b0140b service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:53 user nova-compute[72929]: WARNING nova.compute.manager [req-ba11e62a-11e6-48be-ad3c-6d42ede8b876 req-9de13bbb-88cd-4762-bd4c-d2a923b0140b service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state active and task_state None.
Aug 26 22:06:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Successfully updated port: e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "refresh_cache-d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquired lock "refresh_cache-d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-changed-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Refreshing instance network info cache due to event network-changed-e4225404-e773-4ca8-bb21-95109f2d8969. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] Acquiring lock "refresh_cache-d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:06:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Updating instance_info_cache with network_info: [{"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Releasing lock "refresh_cache-d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Instance network_info: |[{"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] Acquired lock "refresh_cache-d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Refreshing network info cache for port e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Start _get_guest_xml network_info=[{"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:06:55 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:55 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1779389361',display_name='tempest-ServersNegativeTestJSON-server-1779389361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1779389361',id=25,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c177bf6e804c3292dab6eaf860934d',ramdisk_id='',reservation_id='r-gufufmua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789296540',owner_user_name='tempest-ServersNegativeTestJSON-789296540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:53Z,user_data=None,user_id='9c667638141d429e925ecd38af6423fc',uuid=d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converting VIF {"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.objects.instance [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lazy-loading 'pci_devices' on Instance uuid d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:06:55 user nova-compute[72929]:   <uuid>d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc</uuid>
Aug 26 22:06:55 user nova-compute[72929]:   <name>instance-00000019</name>
Aug 26 22:06:55 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:06:55 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:06:55 user nova-compute[72929]:   <metadata>
Aug 26 22:06:55 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:06:55 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:06:55 user nova-compute[72929]:       <nova:name>tempest-ServersNegativeTestJSON-server-1779389361</nova:name>
Aug 26 22:06:55 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:06:55</nova:creationTime>
Aug 26 22:06:55 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:06:55 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:06:55 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:06:55 user nova-compute[72929]:       <nova:owner>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:user uuid="9c667638141d429e925ecd38af6423fc">tempest-ServersNegativeTestJSON-789296540-project-member</nova:user>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:project uuid="60c177bf6e804c3292dab6eaf860934d">tempest-ServersNegativeTestJSON-789296540</nova:project>
Aug 26 22:06:55 user nova-compute[72929]:       </nova:owner>
Aug 26 22:06:55 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:06:55 user nova-compute[72929]:       <nova:ports>
Aug 26 22:06:55 user nova-compute[72929]:         <nova:port uuid="e4225404-e773-4ca8-bb21-95109f2d8969">
Aug 26 22:06:55 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 22:06:55 user nova-compute[72929]:         </nova:port>
Aug 26 22:06:55 user nova-compute[72929]:       </nova:ports>
Aug 26 22:06:55 user nova-compute[72929]:     </nova:instance>
Aug 26 22:06:55 user nova-compute[72929]:   </metadata>
Aug 26 22:06:55 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:06:55 user nova-compute[72929]:     <system>
Aug 26 22:06:55 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:06:55 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:06:55 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:06:55 user nova-compute[72929]:       <entry name="serial">d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc</entry>
Aug 26 22:06:55 user nova-compute[72929]:       <entry name="uuid">d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc</entry>
Aug 26 22:06:55 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:06:55 user nova-compute[72929]:     </system>
Aug 26 22:06:55 user nova-compute[72929]:   </sysinfo>
Aug 26 22:06:55 user nova-compute[72929]:   <os>
Aug 26 22:06:55 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:06:55 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:06:55 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:06:55 user nova-compute[72929]:   </os>
Aug 26 22:06:55 user nova-compute[72929]:   <features>
Aug 26 22:06:55 user nova-compute[72929]:     <acpi/>
Aug 26 22:06:55 user nova-compute[72929]:     <apic/>
Aug 26 22:06:55 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:06:55 user nova-compute[72929]:   </features>
Aug 26 22:06:55 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:06:55 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:06:55 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:06:55 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:06:55 user nova-compute[72929]:   </clock>
Aug 26 22:06:55 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:06:55 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:06:55 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:06:55 user nova-compute[72929]:   </cpu>
Aug 26 22:06:55 user nova-compute[72929]:   <devices>
Aug 26 22:06:55 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:06:55 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:06:55 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk"/>
Aug 26 22:06:55 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:06:55 user nova-compute[72929]:     </disk>
Aug 26 22:06:55 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:06:55 user nova-compute[72929]:       <mac address="fa:16:3e:06:81:42"/>
Aug 26 22:06:55 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:06:55 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:06:55 user nova-compute[72929]:       <target dev="tape4225404-e7"/>
Aug 26 22:06:55 user nova-compute[72929]:     </interface>
Aug 26 22:06:55 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:06:55 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/console.log" append="off"/>
Aug 26 22:06:55 user nova-compute[72929]:     </serial>
Aug 26 22:06:55 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:06:55 user nova-compute[72929]:     <video>
Aug 26 22:06:55 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:06:55 user nova-compute[72929]:     </video>
Aug 26 22:06:55 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:06:55 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:06:55 user nova-compute[72929]:     </rng>
Aug 26 22:06:55 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:06:55 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:06:55 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:06:55 user nova-compute[72929]:     </memballoon>
Aug 26 22:06:55 user nova-compute[72929]:   </devices>
Aug 26 22:06:55 user nova-compute[72929]: </domain>
Aug 26 22:06:55 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1779389361',display_name='tempest-ServersNegativeTestJSON-server-1779389361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1779389361',id=25,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60c177bf6e804c3292dab6eaf860934d',ramdisk_id='',reservation_id='r-gufufmua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-789296540',owner_user_name='tempest-ServersNegativeTestJSON-789296540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:53Z,user_data=None,user_id='9c667638141d429e925ecd38af6423fc',uuid=d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converting VIF {"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG os_vif [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4225404-e7, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4225404-e7, col_values=(('external_ids', {'iface-id': 'e4225404-e773-4ca8-bb21-95109f2d8969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:81:42', 'vm-uuid': 'd6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:55 user nova-compute[72929]: INFO os_vif [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7')
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] No VIF found with MAC fa:16:3e:06:81:42, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Updated VIF entry in instance network info cache for port e4225404-e773-4ca8-bb21-95109f2d8969. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Updating instance_info_cache with network_info: [{"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c45b252-7133-4679-903f-7788612957e7 req-0a8edc5f-854a-4342-abde-bd6359db6ae8 service nova] Releasing lock "refresh_cache-d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing instance network info cache due to event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:06:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:06:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updated VIF entry in instance network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:06:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:06:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7e3f1e4e-18f4-419e-b20c-30a3f9a9697f req-6204bbf8-646e-457b-9d4a-5c566531a2e3 service nova] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:06:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] No waiting events found dispatching network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:57 user nova-compute[72929]: WARNING nova.compute.manager [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received unexpected event network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 for instance with vm_state building and task_state spawning.
Aug 26 22:06:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] No waiting events found dispatching network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:06:57 user nova-compute[72929]: WARNING nova.compute.manager [req-ed6b31fa-1d37-473b-9ed4-6c9fdee07a2b req-17b5e4cc-5699-4544-9774-7f8b31029007 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received unexpected event network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 for instance with vm_state building and task_state spawning.
Aug 26 22:06:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087619.269168, d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] VM Resumed (Lifecycle Event)
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Instance spawned successfully.
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087619.2723932, d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] VM Started (Lifecycle Event)
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.compute.manager [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Took 7.70 seconds to build instance.
Aug 26 22:06:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-84b479d0-8686-4589-a5a9-69c2bb05d77a tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.839s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:06:59 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Creating image(s)
Aug 26 22:06:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:06:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk 1073741824" returned: 0 in 0.097s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087605.4954586, 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:00 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] VM Stopped (Lifecycle Event)
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087605.5163884, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:00 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] VM Stopped (Lifecycle Event)
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-8d81840a-a4f3-4bec-bb2c-1cfea97d51e1 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1504f1a4-c537-4eff-bf8a-6927d50168e4 None None] [instance: 0babcaa6-ae8f-46bb-b265-67b5fe76cf1a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Cannot resize image /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Ensure instance console log exists: /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Start _get_guest_xml network_info=[{"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '9e34bf3b-c41d-4571-a735-24e938d7b979', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca93842d-f13f-4b73-8e2e-06da55cdc8bc', 'attached_at': '', 'detached_at': '', 'volume_id': '58f3a0bd-366b-4049-99eb-91a01af282ff', 'serial': '58f3a0bd-366b-4049-99eb-91a01af282ff'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:07:00 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 22:07:00 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'vcpu_model' on Instance uuid ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:00 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 22:07:00 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:00 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 26 22:07:00 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:00 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:00 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:07:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a715011-0174-446e-928f-75d13556715d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:07:01 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8493438-0251-449c-8827-4df50cc52101]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff] added
Aug 26 22:07:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1a6022-d8d3-43c0-ab61-770a1a435e10]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594de18-d7de-4b1c-9a5d-e5d58bab32c9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdEcZXSi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GdEcZXSi" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d6ce3a-949b-4cc4-8fd5-9103fdf315e1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GdEcZXSi'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f8672-001e-4e89-a660-c41fe00a4bf5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0af78c-1386-493d-aa69-15aa4d54d497]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b43fda0-7a02-492d-a0c5-aad73c317833]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]
Aug 26 22:07:01 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.
Aug 26 22:07:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a57d5da-e3e5-4048-9d16-4644359c0e06]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e414a-aa4a-4f37-8c2d-b65f9d7ef3b4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:01 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:01 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c2d1f-e9b2-4b94-85b5-b6ba4ddbfbcf]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:07:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:02 user nova-compute[72929]: INFO nova.compute.manager [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Shelving
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23438646130636461', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438646130636461', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-979185243',display_name='tempest-ServerActionsTestOtherA-server-344031741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-979185243',id=21,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDr7ycWbe4a18QCutvpkP7CWIG7sFeN9yLq+Fk/+9la9FZ2+WrmjN1SrIaq9M5vapNsgXhY/fqJ+zVC2xw49y0ephiZ/bKzdZoGG4k3f4lcfIHaaq0HpH7+wgK2/e4Lsg==',key_name='tempest-keypair-1072437854',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-8pqov304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=ca93842d-f13f-4b73-8e2e-06da55cdc8bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:07:02 user nova-compute[72929]:   <uuid>ca93842d-f13f-4b73-8e2e-06da55cdc8bc</uuid>
Aug 26 22:07:02 user nova-compute[72929]:   <name>instance-00000015</name>
Aug 26 22:07:02 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:07:02 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:07:02 user nova-compute[72929]:   <metadata>
Aug 26 22:07:02 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:07:02 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:07:02 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherA-server-344031741</nova:name>
Aug 26 22:07:02 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:07:00</nova:creationTime>
Aug 26 22:07:02 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:07:02 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:07:02 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:07:02 user nova-compute[72929]:       <nova:owner>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:user uuid="93c597a2c99646f1bb79645380ce0b75">tempest-ServerActionsTestOtherA-1951554093-project-member</nova:user>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:project uuid="4e6cde0e448142e48abb9220470391f2">tempest-ServerActionsTestOtherA-1951554093</nova:project>
Aug 26 22:07:02 user nova-compute[72929]:       </nova:owner>
Aug 26 22:07:02 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:07:02 user nova-compute[72929]:       <nova:ports>
Aug 26 22:07:02 user nova-compute[72929]:         <nova:port uuid="b77cb74f-4900-4123-9977-e70738850ef2">
Aug 26 22:07:02 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 22:07:02 user nova-compute[72929]:         </nova:port>
Aug 26 22:07:02 user nova-compute[72929]:       </nova:ports>
Aug 26 22:07:02 user nova-compute[72929]:     </nova:instance>
Aug 26 22:07:02 user nova-compute[72929]:   </metadata>
Aug 26 22:07:02 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:07:02 user nova-compute[72929]:     <system>
Aug 26 22:07:02 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:07:02 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:07:02 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:07:02 user nova-compute[72929]:       <entry name="serial">ca93842d-f13f-4b73-8e2e-06da55cdc8bc</entry>
Aug 26 22:07:02 user nova-compute[72929]:       <entry name="uuid">ca93842d-f13f-4b73-8e2e-06da55cdc8bc</entry>
Aug 26 22:07:02 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:07:02 user nova-compute[72929]:     </system>
Aug 26 22:07:02 user nova-compute[72929]:   </sysinfo>
Aug 26 22:07:02 user nova-compute[72929]:   <os>
Aug 26 22:07:02 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:07:02 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:07:02 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:07:02 user nova-compute[72929]:   </os>
Aug 26 22:07:02 user nova-compute[72929]:   <features>
Aug 26 22:07:02 user nova-compute[72929]:     <acpi/>
Aug 26 22:07:02 user nova-compute[72929]:     <apic/>
Aug 26 22:07:02 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:07:02 user nova-compute[72929]:   </features>
Aug 26 22:07:02 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:07:02 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:07:02 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:07:02 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:07:02 user nova-compute[72929]:   </clock>
Aug 26 22:07:02 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:07:02 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:07:02 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:07:02 user nova-compute[72929]:   </cpu>
Aug 26 22:07:02 user nova-compute[72929]:   <devices>
Aug 26 22:07:02 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:07:02 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:07:02 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk"/>
Aug 26 22:07:02 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:07:02 user nova-compute[72929]:     </disk>
Aug 26 22:07:02 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:07:02 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:07:02 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:07:02 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:07:02 user nova-compute[72929]:       <serial>58f3a0bd-366b-4049-99eb-91a01af282ff</serial>
Aug 26 22:07:02 user nova-compute[72929]:     </disk>
Aug 26 22:07:02 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:07:02 user nova-compute[72929]:       <mac address="fa:16:3e:d4:08:ee"/>
Aug 26 22:07:02 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:07:02 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:07:02 user nova-compute[72929]:       <target dev="tapb77cb74f-49"/>
Aug 26 22:07:02 user nova-compute[72929]:     </interface>
Aug 26 22:07:02 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:07:02 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/console.log" append="off"/>
Aug 26 22:07:02 user nova-compute[72929]:     </serial>
Aug 26 22:07:02 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:07:02 user nova-compute[72929]:     <video>
Aug 26 22:07:02 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:07:02 user nova-compute[72929]:     </video>
Aug 26 22:07:02 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:07:02 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:07:02 user nova-compute[72929]:     </rng>
Aug 26 22:07:02 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:07:02 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:07:02 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:07:02 user nova-compute[72929]:     </memballoon>
Aug 26 22:07:02 user nova-compute[72929]:   </devices>
Aug 26 22:07:02 user nova-compute[72929]: </domain>
Aug 26 22:07:02 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-979185243',display_name='tempest-ServerActionsTestOtherA-server-344031741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-979185243',id=21,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDr7ycWbe4a18QCutvpkP7CWIG7sFeN9yLq+Fk/+9la9FZ2+WrmjN1SrIaq9M5vapNsgXhY/fqJ+zVC2xw49y0ephiZ/bKzdZoGG4k3f4lcfIHaaq0HpH7+wgK2/e4Lsg==',key_name='tempest-keypair-1072437854',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:04:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-8pqov304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=ca93842d-f13f-4b73-8e2e-06da55cdc8bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG os_vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb77cb74f-49, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb77cb74f-49, col_values=(('external_ids', {'iface-id': 'b77cb74f-4900-4123-9977-e70738850ef2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:08:ee', 'vm-uuid': 'ca93842d-f13f-4b73-8e2e-06da55cdc8bc'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:02 user nova-compute[72929]: INFO os_vif [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49')
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No VIF found with MAC fa:16:3e:d4:08:ee, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-339ba8b2-bb43-4f8f-8c8f-ec12cdd90d58 req-c9c8f5c8-eb4c-4f65-a51a-d42b4bee210e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-unplugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-339ba8b2-bb43-4f8f-8c8f-ec12cdd90d58 req-c9c8f5c8-eb4c-4f65-a51a-d42b4bee210e service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-339ba8b2-bb43-4f8f-8c8f-ec12cdd90d58 req-c9c8f5c8-eb4c-4f65-a51a-d42b4bee210e service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-339ba8b2-bb43-4f8f-8c8f-ec12cdd90d58 req-c9c8f5c8-eb4c-4f65-a51a-d42b4bee210e service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-339ba8b2-bb43-4f8f-8c8f-ec12cdd90d58 req-c9c8f5c8-eb4c-4f65-a51a-d42b4bee210e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-unplugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:02 user nova-compute[72929]: WARNING nova.compute.manager [req-339ba8b2-bb43-4f8f-8c8f-ec12cdd90d58 req-c9c8f5c8-eb4c-4f65-a51a-d42b4bee210e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-unplugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state active and task_state shelving.
Aug 26 22:07:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance destroyed successfully.
Aug 26 22:07:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Beginning cold snapshot process
Aug 26 22:07:03 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:07:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk /opt/stack/data/nova/instances/snapshots/tmprvp9uuwn/a4deffc5389e429eaffd6ee7acf2b323 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk /opt/stack/data/nova/instances/snapshots/tmprvp9uuwn/a4deffc5389e429eaffd6ee7acf2b323" returned: 0 in 0.484s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:04 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Snapshot extracted, beginning image upload
Aug 26 22:07:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-5b1d826e-4a3c-4918-acc9-d08eecf769c6 req-2d9fdad1-8a83-4567-9d68-851133096065 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5b1d826e-4a3c-4918-acc9-d08eecf769c6 req-2d9fdad1-8a83-4567-9d68-851133096065 service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5b1d826e-4a3c-4918-acc9-d08eecf769c6 req-2d9fdad1-8a83-4567-9d68-851133096065 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5b1d826e-4a3c-4918-acc9-d08eecf769c6 req-2d9fdad1-8a83-4567-9d68-851133096065 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-5b1d826e-4a3c-4918-acc9-d08eecf769c6 req-2d9fdad1-8a83-4567-9d68-851133096065 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:04 user nova-compute[72929]: WARNING nova.compute.manager [req-5b1d826e-4a3c-4918-acc9-d08eecf769c6 req-2d9fdad1-8a83-4567-9d68-851133096065 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state active and task_state shelving_image_uploading.
Aug 26 22:07:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:05 user nova-compute[72929]: INFO nova.compute.manager [None req-17cbf7c6-0567-40fd-ac35-661482f82e46 tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Get console output
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Events pending at deletion: volume-reimaged-f6720532-a4f1-4993-b026-4dac16524e10 {{(pid=72929) _delete_instance /opt/stack/nova/nova/compute/manager.py:3241}}
Aug 26 22:07:06 user nova-compute[72929]: INFO nova.compute.manager [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Terminating instance
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] During wait destroy, instance disappeared. {{(pid=72929) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1517}}
Aug 26 22:07:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Instance destroyed successfully.
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lazy-loading 'resources' on Instance uuid 8555f690-3843-4989-8d93-2bf3ce87e8ef {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T21:58:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1505589036',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1555387934',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxtD5PEaYK9WFv6hquI4w9DEU2Etd046Y+IFfw3MuWoajH3d8UBwNYEvO/enwLXuvZXfthk8hdZ1Ix0bWudI0PJYcAR0Uw9oRkzFP0iWwLTAgbAwO2VzaGd7ci8aoeU1w==',key_name='tempest-keypair-916840740',keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:58:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='9d7fb7f0afaa4a57a7fb9bd4e4a41f5e',ramdisk_id='',reservation_id='r-xl9uw4da',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-550646581',owner_user_name='tempest-ServerActionsV293TestJSON-550646581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:03:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c14a8b7c012414ca17ec7ed1630ac02',uuid=8555f690-3843-4989-8d93-2bf3ce87e8ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converting VIF {"id": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "address": "fa:16:3e:ae:a1:4e", "network": {"id": "76f50851-64bd-4c38-8378-dc64a4e9f42f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-499613763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d7fb7f0afaa4a57a7fb9bd4e4a41f5e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d0845c8-db", "ovs_interfaceid": "6d0845c8-db04-4979-8dc2-3e60a8b3536b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_vif [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d0845c8-db, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:07:06 user nova-compute[72929]: INFO os_vif [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:4e,bridge_name='br-int',has_traffic_filtering=True,id=6d0845c8-db04-4979-8dc2-3e60a8b3536b,network=Network(76f50851-64bd-4c38-8378-dc64a4e9f42f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d0845c8-db')
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWFRKoqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:06 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6720532-a4f1-4993-b026-4dac16524e10', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8926d857-9729-441d-bf30-4365ebfe06cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14bddbd-49ff-4bab-96fc-9f3379dfde55]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:06 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:06 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:06 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:06 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803b1630>, {}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Disconnecting from: [] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] <== disconnect_volume: return (79ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:07:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Deletion of /opt/stack/data/nova/instances/8555f690-3843-4989-8d93-2bf3ce87e8ef_del complete
Aug 26 22:07:06 user nova-compute[72929]: INFO nova.compute.manager [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Took 0.30 seconds to destroy the instance on the hypervisor.
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:06 user nova-compute[72929]: WARNING nova.compute.manager [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:06 user nova-compute[72929]: WARNING nova.compute.manager [req-059f8eb7-cc03-41cd-8a6c-810d6b12ceaa req-6371512c-5bb8-4a49-8a78-153f2432aaaa service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state active and task_state rebuild_spawning.
Aug 26 22:07:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087627.8089252, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] VM Resumed (Lifecycle Event)
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:07:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance spawned successfully.
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087627.814317, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] VM Started (Lifecycle Event)
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 26 22:07:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:08 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Took 1.61 seconds to deallocate network for instance.
Aug 26 22:07:08 user nova-compute[72929]: INFO nova.compute.manager [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Took 0.09 seconds to detach 1 volumes for instance.
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Deleting volume: f6720532-a4f1-4993-b026-4dac16524e10 {{(pid=72929) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72929) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1826f421-5d93-4506-bf86-bf7b322aa583 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.155s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Snapshot image upload complete
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:08 user nova-compute[72929]: INFO nova.compute.manager [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Shelve offloading
Aug 26 22:07:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance destroyed successfully.
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:07:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-05722a61-769f-414e-836d-8ff0154f133d req-f081f3c8-54e4-4998-bf0f-d5546478c78c service nova] [instance: 8555f690-3843-4989-8d93-2bf3ce87e8ef] Received event network-vif-deleted-6d0845c8-db04-4979-8dc2-3e60a8b3536b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:09 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:07:09 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:07:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.749s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:09 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Deleted allocations for instance 8555f690-3843-4989-8d93-2bf3ce87e8ef
Aug 26 22:07:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d76eb37e-c7a1-4dd7-b534-361020e9bbda tempest-ServerActionsV293TestJSON-550646581 tempest-ServerActionsV293TestJSON-550646581-project-member] Lock "8555f690-3843-4989-8d93-2bf3ce87e8ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.160s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance destroyed successfully.
Aug 26 22:07:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'resources' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-738784921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-738784921',id=23,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfNpwEcgMoxwh1kvGHHdd6/D1xmuG4A8l5F1mE9k0yQA+NLV/dyW1tqMh/GoiJ6T8r1WS8RAWQueqpULpn/3q31K80VMxZGdCgH1yzS/MrTzni1jf6oYHlcdq6HAQdZg==',key_name='tempest-keypair-1698526643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-ujoxx46c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member',shelved_at='2023-08-26T22:07:08.734311',shelved_host='user',shelved_image_id='143449c1-2485-419f-864c-75bab561a3e9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:07:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=387ba104-895e-433c-a100-51b98acf8c15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG os_vif [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31f5f5c0-90, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:07:10 user nova-compute[72929]: INFO os_vif [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90')
Aug 26 22:07:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Deleting instance files /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15_del
Aug 26 22:07:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Deletion of /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15_del complete
Aug 26 22:07:10 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Deleted allocations for instance 387ba104-895e-433c-a100-51b98acf8c15
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing instance network info cache due to event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'numa_topology' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.objects.base [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<387ba104-895e-433c-a100-51b98acf8c15> lazy-loaded attributes: resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'flavor' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f408a7f3-ddd1-4606-bff2-5dcb772e15a5 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.660s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:11 user nova-compute[72929]: INFO nova.compute.manager [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Attaching volume 92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 to /dev/vdb
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:11 user nova-compute[72929]: INFO nova.compute.manager [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attaching volume 15c3d657-9ec3-4558-b103-aca98a09ab8b to /dev/vdb
Aug 26 22:07:11 user nova-compute[72929]: DEBUG os_brick.utils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[76537f9e-cbe3-4f1e-9795-8057deafaab8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG os_brick.utils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94afecb-ae38-4ae8-b392-dddfca577876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2d4921-e855-4f7e-8fbb-5e5224e0d0a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[784319b8-322c-4cd0-ae89-19e7eabc8224]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172bad9-f7a2-4345-a7bc-19bd05b9733f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4b4ed5-27f1-4d27-bacc-203faa6bc247]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:12 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90f84ca-d7c4-4cd5-b825-8ba08e443c33]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.utils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating existing volume attachment record: d9b1e849-f80c-41ad-8ae4-f9778a4f27b5 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e8e52-b874-4d43-87f6-3471c7e7597d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58e0ab5-3f69-4aa2-b6c9-bfe7ad89bae3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:12 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c6cb70-0a19-4ffb-93c8-0384dc325aff]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG os_brick.utils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating existing volume attachment record: 35478ee7-6b31-43b2-ba41-177fed661ccc {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG nova.network.neutron [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updated VIF entry in instance network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG nova.network.neutron [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-968acd47-c8ad-415d-895a-68bc4b16fe24 req-4e7a1305-465a-4f09-a3af-5240a088176e service nova] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:15 user nova-compute[72929]: INFO nova.compute.manager [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Terminating instance
Aug 26 22:07:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Instance destroyed successfully.
Aug 26 22:07:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'resources' on Instance uuid 63d06f04-417d-4f92-bf7c-d4809e518d2a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-231720761',display_name='tempest-AttachVolumeNegativeTest-server-231720761',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-231720761',id=20,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEuCgs8dAPbDab71TTdu0JVo8oZOy6wlQsPtEBNj/MtMTJnLZ0HqmIjdZl6+wiSBtB4jl46F6RiN5il7GaN2Qpj3BKFYxUZAVtnjiN8zOMjid5W7RsT2NReJOeCKi76Ng==',key_name='tempest-keypair-327929541',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-5rp8rfzy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:04:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=63d06f04-417d-4f92-bf7c-d4809e518d2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "99b17457-c0da-41f5-a632-9aeffe501810", "address": "fa:16:3e:b7:46:0a", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b17457-c0", "ovs_interfaceid": "99b17457-c0da-41f5-a632-9aeffe501810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG os_vif [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99b17457-c0, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:07:16 user nova-compute[72929]: INFO os_vif [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:46:0a,bridge_name='br-int',has_traffic_filtering=True,id=99b17457-c0da-41f5-a632-9aeffe501810,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99b17457-c0')
Aug 26 22:07:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Deleting instance files /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a_del
Aug 26 22:07:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Deletion of /opt/stack/data/nova/instances/63d06f04-417d-4f92-bf7c-d4809e518d2a_del complete
Aug 26 22:07:16 user nova-compute[72929]: INFO nova.compute.manager [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 22:07:16 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:07:16 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:07:17 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:17 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Took 0.90 seconds to deallocate network for instance.
Aug 26 22:07:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-a0e03bdd-ee40-405e-b60d-e87f92b85294 req-7e7e9979-5d9c-4c8e-a8ed-1c94da6bd264 service nova] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Received event network-vif-deleted-99b17457-c0da-41f5-a632-9aeffe501810 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:17 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:07:17 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:07:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:18 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Deleted allocations for instance 63d06f04-417d-4f92-bf7c-d4809e518d2a
Aug 26 22:07:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-837da8b6-3e84-4f98-89ef-bc4960234383 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "63d06f04-417d-4f92-bf7c-d4809e518d2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.590s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:18 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087623.271081, 387ba104-895e-433c-a100-51b98acf8c15 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:18 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] VM Stopped (Lifecycle Event)
Aug 26 22:07:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7fddaa0e-9091-4764-b416-bdb359164d3f None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:18 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.009s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:07:20 user nova-compute[72929]: INFO nova.compute.claims [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Claim successful on node user
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:07:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:07:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.policy [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e6d3ec106b9413f8879d505213b3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8342795a1fd4e0da2e3bd1bb7599281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:07:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Creating image(s)
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "/opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "/opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.220s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk 1073741824" returned: 0 in 0.063s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Successfully created port: cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.243s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Cannot resize image /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Ensure instance console log exists: /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Successfully updated port: cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "refresh_cache-3d4b6c0c-916e-4698-9add-32f3e85216cd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquired lock "refresh_cache-3d4b6c0c-916e-4698-9add-32f3e85216cd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-changed-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Refreshing instance network info cache due to event network-changed-cd29aa46-156e-4e40-9c14-71b79880fb9b. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:07:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] Acquiring lock "refresh_cache-3d4b6c0c-916e-4698-9add-32f3e85216cd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Updating instance_info_cache with network_info: [{"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Releasing lock "refresh_cache-3d4b6c0c-916e-4698-9add-32f3e85216cd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Instance network_info: |[{"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] Acquired lock "refresh_cache-3d4b6c0c-916e-4698-9add-32f3e85216cd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.neutron [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Refreshing network info cache for port cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Start _get_guest_xml network_info=[{"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:23 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:07:23 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-879435078',display_name='tempest-VolumesActionsTest-instance-879435078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-879435078',id=26,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8342795a1fd4e0da2e3bd1bb7599281',ramdisk_id='',reservation_id='r-iz1uijai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1243309740',owner_user_name='tempest-VolumesActionsTest-1243309740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:07:21Z,user_data=None,user_id='7e6d3ec106b9413f8879d505213b3466',uuid=3d4b6c0c-916e-4698-9add-32f3e85216cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converting VIF {"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d4b6c0c-916e-4698-9add-32f3e85216cd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:07:23 user nova-compute[72929]:   <uuid>3d4b6c0c-916e-4698-9add-32f3e85216cd</uuid>
Aug 26 22:07:23 user nova-compute[72929]:   <name>instance-0000001a</name>
Aug 26 22:07:23 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:07:23 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:07:23 user nova-compute[72929]:   <metadata>
Aug 26 22:07:23 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:07:23 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:07:23 user nova-compute[72929]:       <nova:name>tempest-VolumesActionsTest-instance-879435078</nova:name>
Aug 26 22:07:23 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:07:23</nova:creationTime>
Aug 26 22:07:23 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:07:23 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:07:23 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:07:23 user nova-compute[72929]:       <nova:owner>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:user uuid="7e6d3ec106b9413f8879d505213b3466">tempest-VolumesActionsTest-1243309740-project-member</nova:user>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:project uuid="c8342795a1fd4e0da2e3bd1bb7599281">tempest-VolumesActionsTest-1243309740</nova:project>
Aug 26 22:07:23 user nova-compute[72929]:       </nova:owner>
Aug 26 22:07:23 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:07:23 user nova-compute[72929]:       <nova:ports>
Aug 26 22:07:23 user nova-compute[72929]:         <nova:port uuid="cd29aa46-156e-4e40-9c14-71b79880fb9b">
Aug 26 22:07:23 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 22:07:23 user nova-compute[72929]:         </nova:port>
Aug 26 22:07:23 user nova-compute[72929]:       </nova:ports>
Aug 26 22:07:23 user nova-compute[72929]:     </nova:instance>
Aug 26 22:07:23 user nova-compute[72929]:   </metadata>
Aug 26 22:07:23 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:07:23 user nova-compute[72929]:     <system>
Aug 26 22:07:23 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:07:23 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:07:23 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:07:23 user nova-compute[72929]:       <entry name="serial">3d4b6c0c-916e-4698-9add-32f3e85216cd</entry>
Aug 26 22:07:23 user nova-compute[72929]:       <entry name="uuid">3d4b6c0c-916e-4698-9add-32f3e85216cd</entry>
Aug 26 22:07:23 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:07:23 user nova-compute[72929]:     </system>
Aug 26 22:07:23 user nova-compute[72929]:   </sysinfo>
Aug 26 22:07:23 user nova-compute[72929]:   <os>
Aug 26 22:07:23 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:07:23 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:07:23 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:07:23 user nova-compute[72929]:   </os>
Aug 26 22:07:23 user nova-compute[72929]:   <features>
Aug 26 22:07:23 user nova-compute[72929]:     <acpi/>
Aug 26 22:07:23 user nova-compute[72929]:     <apic/>
Aug 26 22:07:23 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:07:23 user nova-compute[72929]:   </features>
Aug 26 22:07:23 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:07:23 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:07:23 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:07:23 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:07:23 user nova-compute[72929]:   </clock>
Aug 26 22:07:23 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:07:23 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:07:23 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:07:23 user nova-compute[72929]:   </cpu>
Aug 26 22:07:23 user nova-compute[72929]:   <devices>
Aug 26 22:07:23 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:07:23 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:07:23 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk"/>
Aug 26 22:07:23 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:07:23 user nova-compute[72929]:     </disk>
Aug 26 22:07:23 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:07:23 user nova-compute[72929]:       <mac address="fa:16:3e:04:8a:cc"/>
Aug 26 22:07:23 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:07:23 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:07:23 user nova-compute[72929]:       <target dev="tapcd29aa46-15"/>
Aug 26 22:07:23 user nova-compute[72929]:     </interface>
Aug 26 22:07:23 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:07:23 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/console.log" append="off"/>
Aug 26 22:07:23 user nova-compute[72929]:     </serial>
Aug 26 22:07:23 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:07:23 user nova-compute[72929]:     <video>
Aug 26 22:07:23 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:07:23 user nova-compute[72929]:     </video>
Aug 26 22:07:23 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:07:23 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:07:23 user nova-compute[72929]:     </rng>
Aug 26 22:07:23 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:07:23 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:07:23 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:07:23 user nova-compute[72929]:     </memballoon>
Aug 26 22:07:23 user nova-compute[72929]:   </devices>
Aug 26 22:07:23 user nova-compute[72929]: </domain>
Aug 26 22:07:23 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-879435078',display_name='tempest-VolumesActionsTest-instance-879435078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-879435078',id=26,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8342795a1fd4e0da2e3bd1bb7599281',ramdisk_id='',reservation_id='r-iz1uijai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1243309740',owner_user_name='tempest-VolumesActionsTest-1243309740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:07:21Z,user_data=None,user_id='7e6d3ec106b9413f8879d505213b3466',uuid=3d4b6c0c-916e-4698-9add-32f3e85216cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converting VIF {"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG os_vif [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd29aa46-15, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcd29aa46-15, col_values=(('external_ids', {'iface-id': 'cd29aa46-156e-4e40-9c14-71b79880fb9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:8a:cc', 'vm-uuid': '3d4b6c0c-916e-4698-9add-32f3e85216cd'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:23 user nova-compute[72929]: INFO os_vif [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15')
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] No VIF found with MAC fa:16:3e:04:8a:cc, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Updated VIF entry in instance network info cache for port cd29aa46-156e-4e40-9c14-71b79880fb9b. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Updating instance_info_cache with network_info: [{"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-98e09c29-5be1-4e13-8fd1-f1c422359a15 req-3a9db134-08f6-4d54-87d7-6c7abc66582a service nova] Releasing lock "refresh_cache-3d4b6c0c-916e-4698-9add-32f3e85216cd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087647.497276, 3d4b6c0c-916e-4698-9add-32f3e85216cd => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:27 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] VM Resumed (Lifecycle Event)
Aug 26 22:07:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-89678a6b-3898-48cc-a078-184960a1ab63 req-0dd75669-ced4-403d-81cf-b5ff4042f566 service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-89678a6b-3898-48cc-a078-184960a1ab63 req-0dd75669-ced4-403d-81cf-b5ff4042f566 service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-89678a6b-3898-48cc-a078-184960a1ab63 req-0dd75669-ced4-403d-81cf-b5ff4042f566 service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-89678a6b-3898-48cc-a078-184960a1ab63 req-0dd75669-ced4-403d-81cf-b5ff4042f566 service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-89678a6b-3898-48cc-a078-184960a1ab63 req-0dd75669-ced4-403d-81cf-b5ff4042f566 service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:27 user nova-compute[72929]: WARNING nova.compute.manager [req-89678a6b-3898-48cc-a078-184960a1ab63 req-0dd75669-ced4-403d-81cf-b5ff4042f566 service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received unexpected event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with vm_state building and task_state spawning.
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-84d69eff-be64-4ff4-9042-019f03dfc8df req-fff6817c-6b83-4e78-acd4-f7272dc7a1e7 service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84d69eff-be64-4ff4-9042-019f03dfc8df req-fff6817c-6b83-4e78-acd4-f7272dc7a1e7 service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84d69eff-be64-4ff4-9042-019f03dfc8df req-fff6817c-6b83-4e78-acd4-f7272dc7a1e7 service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84d69eff-be64-4ff4-9042-019f03dfc8df req-fff6817c-6b83-4e78-acd4-f7272dc7a1e7 service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-84d69eff-be64-4ff4-9042-019f03dfc8df req-fff6817c-6b83-4e78-acd4-f7272dc7a1e7 service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:27 user nova-compute[72929]: WARNING nova.compute.manager [req-84d69eff-be64-4ff4-9042-019f03dfc8df req-fff6817c-6b83-4e78-acd4-f7272dc7a1e7 service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received unexpected event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with vm_state building and task_state spawning.
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACEGkQxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:27 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:27 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:27 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:07:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:28 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:28 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:07:28 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7287MB free_disk=24.309215545654297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[675e5782-bac6-4d99-bb9f-71ba31f1ddf4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:07:28 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087647.4989667, 3d4b6c0c-916e-4698-9add-32f3e85216cd => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:28 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] VM Started (Lifecycle Event)
Aug 26 22:07:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Instance spawned successfully.
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfafa5ae-a37f-4d79-98ce-71be35807382]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b] added
Aug 26 22:07:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:07:28 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[de065a5b-96f6-4f52-b4e3-0e3a5cbf8e4a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9f3ba4-eb77-453a-b5dd-45a753f47f9f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACEGkQxd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ACEGkQxd" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c7686c-80c4-4d13-9e55-9329703158f6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ACEGkQxd'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: INFO nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Took 6.83 seconds to spawn the instance on the hypervisor.
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[15254442-a49f-449f-9dfa-0ceadfc1b737]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3d4b6c0c-916e-4698-9add-32f3e85216cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee45e1d-8223-429f-a889-80276c185eb2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:28 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:28 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: INFO nova.compute.manager [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Took 7.97 seconds to build instance.
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[968ba149-bbd7-4c7e-86ff-4fb34dc57c7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260]
Aug 26 22:07:28 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260] successful.
Aug 26 22:07:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3344de95-445c-4579-99b0-7d97f7a27c9f tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.085s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0291e892-9cff-4c45-b8f0-4de85e6057d6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2345f7-6854-4268-b0de-2db83b0723f7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:28 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:28 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:28 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:28 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca724006-134a-41be-896f-0395f134bb1c]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACEGkQxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23039323731666630', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039323731666630', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.401s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:29 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:29 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67009764-5efc-493e-a2e5-456db0c5f9b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:07:29 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:07:29 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:07:29 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:07:29 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:07:29 user nova-compute[72929]:   <serial>15c3d657-9ec3-4558-b103-aca98a09ab8b</serial>
Aug 26 22:07:29 user nova-compute[72929]: </disk>
Aug 26 22:07:29 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7284f6-67dc-4047-818e-fc64f8aad60b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94] added
Aug 26 22:07:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f05f6-02ca-47aa-953c-897de1e9eec1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[953f9ff3-2099-424a-9746-c7bcdd47852d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnYesQmi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnYesQmi" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4312b-3544-4e13-972c-a311ac22dcba]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnYesQmi'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d3a395-f702-4bd0-96b7-31aa75b21124]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b0bfca-dd68-47a0-a26e-6f7ae4a5194d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f581d02d-d5b8-46d6-9a1f-16e6123d273a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]
Aug 26 22:07:29 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.
Aug 26 22:07:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93613a86-da60-4074-8361-f4374310e38c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a455b7-45f7-47ea-b614-bac23827bf05]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:29 user nova-compute[72929]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2108a180-2f3a-40d6-8661-dcd5e21920bf]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] No VIF found with MAC fa:16:3e:d1:91:3e, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0c159395-ae6a-4fb7-8ec8-6f0472dad785 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.335s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== connect_volume: return (2759ms) {'type': 'block', 'scsi_wwn': '26632333264363137', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632333264363137', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'flavor' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:07:30 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:07:30 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:07:30 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:07:30 user nova-compute[72929]:   <serial>92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94</serial>
Aug 26 22:07:30 user nova-compute[72929]: </disk>
Aug 26 22:07:30 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No VIF found with MAC fa:16:3e:4b:0f:09, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087636.3636422, 63d06f04-417d-4f92-bf7c-d4809e518d2a => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:31 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] VM Stopped (Lifecycle Event)
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2950bbee-ecaf-4fe8-b1d4-4a01d6ab7afc None None] [instance: 63d06f04-417d-4f92-bf7c-d4809e518d2a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a716a35-9f1b-42ff-ae52-47a296fe395b tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.705s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:31 user nova-compute[72929]: INFO nova.compute.manager [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Detaching volume 15c3d657-9ec3-4558-b103-aca98a09ab8b
Aug 26 22:07:32 user nova-compute[72929]: INFO nova.virt.block_device [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attempting to driver detach volume 15c3d657-9ec3-4558-b103-aca98a09ab8b from mountpoint /dev/vdb
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Attempting to detach device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:07:32 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:07:32 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:07:32 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:07:32 user nova-compute[72929]:   <serial>15c3d657-9ec3-4558-b103-aca98a09ab8b</serial>
Aug 26 22:07:32 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:07:32 user nova-compute[72929]: </disk>
Aug 26 22:07:32 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:07:32 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully detached device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the persistent domain config.
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:07:32 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:07:32 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:07:32 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:07:32 user nova-compute[72929]:   <serial>15c3d657-9ec3-4558-b103-aca98a09ab8b</serial>
Aug 26 22:07:32 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:07:32 user nova-compute[72929]: </disk>
Aug 26 22:07:32 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087652.499001, 3db3d467-df63-4ea0-951b-4eee4460980f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:07:32 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully detached device vdb from instance 3db3d467-df63-4ea0-951b-4eee4460980f from the live domain config.
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ACEGkQxd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:32 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e77b4a-7179-48f8-8346-338d28b8c227]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00518f20-068e-405f-a775-1525cddbaee4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:32 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:32 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:32 user nova-compute[72929]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:32 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:32 user nova-compute[72929]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b (non-flash)
Aug 26 22:07:32 user nova-compute[72929]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b982a7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0df1215-5228-46ef-87a0-8f42d906e16a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3d920f-7c98-4e98-bbf3-3c870dea2e07]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439127c-c804-438d-8abf-5b1428609908]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aa91ba-dabe-46cd-acfe-e98057c1eb6b]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b401264-15ad-4f24-bc4b-c306c7ddedf4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a644a5c4-9b24-4bc9-b39b-0b4a0eb8feb9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260]
Aug 26 22:07:32 user nova-compute[72929]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b, portal: 172.16.0.220,3260] successful.
Aug 26 22:07:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15c3d657-9ec3-4558-b103-aca98a09ab8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e749f1-00b1-4c7d-8fc2-e64dab386bc2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== disconnect_volume: return (353ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:07:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0bab989-f528-471f-b542-85bf3872823e tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.862s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Stashing vm_state: active {{(pid=72929) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:07:34 user nova-compute[72929]: INFO nova.compute.claims [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Claim successful on node user
Aug 26 22:07:34 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating resource usage from migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39
Aug 26 22:07:34 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.393s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:34 user nova-compute[72929]: INFO nova.compute.manager [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Migrating
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:34 user nova-compute[72929]: INFO nova.compute.rpcapi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Starting migrate_disk_and_power_off {{(pid=72929) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-f58e6eb4-4a63-481c-96f4-61b7cb05233e req-1eea80ba-2a01-4b66-878d-8ba2859b7fe1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f58e6eb4-4a63-481c-96f4-61b7cb05233e req-1eea80ba-2a01-4b66-878d-8ba2859b7fe1 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f58e6eb4-4a63-481c-96f4-61b7cb05233e req-1eea80ba-2a01-4b66-878d-8ba2859b7fe1 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f58e6eb4-4a63-481c-96f4-61b7cb05233e req-1eea80ba-2a01-4b66-878d-8ba2859b7fe1 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-f58e6eb4-4a63-481c-96f4-61b7cb05233e req-1eea80ba-2a01-4b66-878d-8ba2859b7fe1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:35 user nova-compute[72929]: WARNING nova.compute.manager [req-f58e6eb4-4a63-481c-96f4-61b7cb05233e req-1eea80ba-2a01-4b66-878d-8ba2859b7fe1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state active and task_state resize_migrating.
Aug 26 22:07:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance destroyed successfully.
Aug 26 22:07:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a8d4c8c-26, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:07:36 user nova-compute[72929]: INFO os_vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26')
Aug 26 22:07:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:36 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e73d503-c35a-4dfe-b440-cfedb805e320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadf180a-077d-48ee-89ed-43cbbeaca621]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:36 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:36 user nova-compute[72929]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:36 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:36 user nova-compute[72929]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b80796b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ab11ca-2ca9-4f20-88af-b2ab34b2ca6d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[279549a8-3f3b-43f8-9361-dca470e4c335]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3836f7f-6b6b-467f-b437-c7cf97f593a5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2f1949-a8b8-460f-8c91-59293d7cdf6d]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b286d827-c9fb-46f4-b44d-11059a708063]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1a041e-6551-42b5-8060-63fc8a544a81]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]
Aug 26 22:07:36 user nova-compute[72929]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.
Aug 26 22:07:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a3f34-09de-4b94-aae2-8aa766ecb122]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== disconnect_volume: return (288ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:07:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525_resize/disk /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "cp -r /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525_resize/disk /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk" returned: 0 in 0.279s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525_resize/disk.info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk.info {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "cp -r /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525_resize/disk.info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk.info" returned: 0 in 0.035s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-00a2f99e-acfa-4880-9926-cff9e6c7efb7 req-f288c1da-7a3e-4ad6-a536-4b4b55a8e0ae service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00a2f99e-acfa-4880-9926-cff9e6c7efb7 req-f288c1da-7a3e-4ad6-a536-4b4b55a8e0ae service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00a2f99e-acfa-4880-9926-cff9e6c7efb7 req-f288c1da-7a3e-4ad6-a536-4b4b55a8e0ae service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-00a2f99e-acfa-4880-9926-cff9e6c7efb7 req-f288c1da-7a3e-4ad6-a536-4b4b55a8e0ae service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-00a2f99e-acfa-4880-9926-cff9e6c7efb7 req-f288c1da-7a3e-4ad6-a536-4b4b55a8e0ae service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:38 user nova-compute[72929]: WARNING nova.compute.manager [req-00a2f99e-acfa-4880-9926-cff9e6c7efb7 req-f288c1da-7a3e-4ad6-a536-4b4b55a8e0ae service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state active and task_state resize_migrating.
Aug 26 22:07:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Port 7a8d4c8c-2672-4af8-b42e-54be12e2544e binding to destination host user is already ACTIVE {{(pid=72929) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG os_brick.utils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e40aa6-531e-4237-b697-f961c1889f43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[321c0e76-2e97-4c55-ac39-99c3f862d8bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ca65a-0321-49a3-90d6-952c54822689]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ed4429-07c5-4ec3-b89a-9fe2d837aed9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:39 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:07:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec110777-c3ae-41bd-aba2-52934f55c41c]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:07:39 user nova-compute[72929]: DEBUG os_brick.utils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Starting finish_migration {{(pid=72929) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:07:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Creating image(s)
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk. size=21474836480 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk 21474836480 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk 21474836480" returned: 0 in 0.044s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Ensure instance console log exists: /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start _get_guest_xml network_info=[{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'da4e5974-ec02-464f-b626-57aca35ec9fe', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '17b027b1-b249-4fc9-a8f5-43e0cf919525', 'attached_at': '2023-08-26T22:07:50.000000', 'detached_at': '', 'volume_id': '92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94', 'serial': '92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:07:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:07:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:07:50 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfbcaa1-7e8f-464a-aa52-b1de7a4d32b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:07:50 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1649e218-95db-4c5d-8879-a9c3416ef23f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94] added
Aug 26 22:07:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39a110b-1d37-4096-81d1-38ac4625da11]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edfbb08-cd03-4282-b286-3b4a0aa95f2c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnYesQmi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnYesQmi" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b44888-062f-43e4-9ed5-b7ee6247ddd0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnYesQmi'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e172d1-7752-4993-9a31-cfe9c092cfb9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2e6ac-3bed-4613-a906-2d0cdfdb912a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:50 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:51 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadb96dc-9520-4b56-8540-c884579980bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]
Aug 26 22:07:51 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.
Aug 26 22:07:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c32de74-89c6-4f09-a462-e2a5d919aaae]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d5fd8b-1298-4c0b-99f2-b431b1d48c31]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:51 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:51 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:07:51 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:07:51 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:07:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ce360e-3c4a-464d-b3b0-07b9f61ecf1b]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087656.1723094, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:51 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Stopped (Lifecycle Event)
Aug 26 22:07:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0fc73df1-9d5b-4aab-b05d-8165b2fc1a03 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0fc73df1-9d5b-4aab-b05d-8165b2fc1a03 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:51 user nova-compute[72929]: INFO nova.compute.manager [None req-0fc73df1-9d5b-4aab-b05d-8165b2fc1a03 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 22:07:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26632333264363137', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632333264363137', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:07:52 user nova-compute[72929]:   <uuid>17b027b1-b249-4fc9-a8f5-43e0cf919525</uuid>
Aug 26 22:07:52 user nova-compute[72929]:   <name>instance-00000013</name>
Aug 26 22:07:52 user nova-compute[72929]:   <memory>2097152</memory>
Aug 26 22:07:52 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:07:52 user nova-compute[72929]:   <metadata>
Aug 26 22:07:52 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:07:52 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:07:52 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherB-server-1992218640</nova:name>
Aug 26 22:07:52 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:07:50</nova:creationTime>
Aug 26 22:07:52 user nova-compute[72929]:       <nova:flavor name="m1.small">
Aug 26 22:07:52 user nova-compute[72929]:         <nova:memory>2048</nova:memory>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:disk>20</nova:disk>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:07:52 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:07:52 user nova-compute[72929]:       <nova:owner>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:user uuid="9c6aeec78644486ba130cf6084d76887">tempest-ServerActionsTestOtherB-381550606-project-member</nova:user>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:project uuid="2e7f712c6e7e418caa20ca971c810660">tempest-ServerActionsTestOtherB-381550606</nova:project>
Aug 26 22:07:52 user nova-compute[72929]:       </nova:owner>
Aug 26 22:07:52 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:07:52 user nova-compute[72929]:       <nova:ports>
Aug 26 22:07:52 user nova-compute[72929]:         <nova:port uuid="7a8d4c8c-2672-4af8-b42e-54be12e2544e">
Aug 26 22:07:52 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:07:52 user nova-compute[72929]:         </nova:port>
Aug 26 22:07:52 user nova-compute[72929]:       </nova:ports>
Aug 26 22:07:52 user nova-compute[72929]:     </nova:instance>
Aug 26 22:07:52 user nova-compute[72929]:   </metadata>
Aug 26 22:07:52 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:07:52 user nova-compute[72929]:     <system>
Aug 26 22:07:52 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:07:52 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:07:52 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:07:52 user nova-compute[72929]:       <entry name="serial">17b027b1-b249-4fc9-a8f5-43e0cf919525</entry>
Aug 26 22:07:52 user nova-compute[72929]:       <entry name="uuid">17b027b1-b249-4fc9-a8f5-43e0cf919525</entry>
Aug 26 22:07:52 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:07:52 user nova-compute[72929]:     </system>
Aug 26 22:07:52 user nova-compute[72929]:   </sysinfo>
Aug 26 22:07:52 user nova-compute[72929]:   <os>
Aug 26 22:07:52 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:07:52 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:07:52 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:07:52 user nova-compute[72929]:   </os>
Aug 26 22:07:52 user nova-compute[72929]:   <features>
Aug 26 22:07:52 user nova-compute[72929]:     <acpi/>
Aug 26 22:07:52 user nova-compute[72929]:     <apic/>
Aug 26 22:07:52 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:07:52 user nova-compute[72929]:   </features>
Aug 26 22:07:52 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:07:52 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:07:52 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:07:52 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:07:52 user nova-compute[72929]:   </clock>
Aug 26 22:07:52 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:07:52 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:07:52 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:07:52 user nova-compute[72929]:   </cpu>
Aug 26 22:07:52 user nova-compute[72929]:   <devices>
Aug 26 22:07:52 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:07:52 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:07:52 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk"/>
Aug 26 22:07:52 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:07:52 user nova-compute[72929]:     </disk>
Aug 26 22:07:52 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:07:52 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:07:52 user nova-compute[72929]:       <source dev="/dev/sdd"/>
Aug 26 22:07:52 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:07:52 user nova-compute[72929]:       <serial>92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94</serial>
Aug 26 22:07:52 user nova-compute[72929]:     </disk>
Aug 26 22:07:52 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:07:52 user nova-compute[72929]:       <mac address="fa:16:3e:4b:0f:09"/>
Aug 26 22:07:52 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:07:52 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:07:52 user nova-compute[72929]:       <target dev="tap7a8d4c8c-26"/>
Aug 26 22:07:52 user nova-compute[72929]:     </interface>
Aug 26 22:07:52 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:07:52 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/console.log" append="off"/>
Aug 26 22:07:52 user nova-compute[72929]:     </serial>
Aug 26 22:07:52 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:07:52 user nova-compute[72929]:     <video>
Aug 26 22:07:52 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:07:52 user nova-compute[72929]:     </video>
Aug 26 22:07:52 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:07:52 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:07:52 user nova-compute[72929]:     </rng>
Aug 26 22:07:52 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:07:52 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:07:52 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:07:52 user nova-compute[72929]:     </memballoon>
Aug 26 22:07:52 user nova-compute[72929]:   </devices>
Aug 26 22:07:52 user nova-compute[72929]: </domain>
Aug 26 22:07:52 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:03:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-997311350-network", "vif_mac": "fa:16:3e:4b:0f:09"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG os_vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a8d4c8c-26, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a8d4c8c-26, col_values=(('external_ids', {'iface-id': '7a8d4c8c-2672-4af8-b42e-54be12e2544e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0f:09', 'vm-uuid': '17b027b1-b249-4fc9-a8f5-43e0cf919525'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:52 user nova-compute[72929]: INFO os_vif [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26')
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] No VIF found with MAC fa:16:3e:4b:0f:09, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:07:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing instance network info cache due to event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'flavor' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:53 user nova-compute[72929]: INFO nova.compute.manager [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Attaching volume 3db27446-b610-4a9c-a04d-2045bc02d7c2 to /dev/vdb
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updated VIF entry in instance network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG os_brick.utils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f56fc9-abd0-4168-b29f-9ece946078e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13c72983-b91e-486f-a76d-b1a83b66d01d req-131b5963-45a4-403b-a00f-c758019e865f service nova] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8857d0-62f5-4629-aae2-a88b3686615a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3102f4-3204-4fa5-b9e9-b407ed77d30a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5bc8b-3ad3-4aca-8808-eedea401e1ba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-694b83e7-44a9-4afa-9723-d363ff4c4f42 req-3b1ed48f-f730-4cfe-a846-bea1f490ed45 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-694b83e7-44a9-4afa-9723-d363ff4c4f42 req-3b1ed48f-f730-4cfe-a846-bea1f490ed45 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-694b83e7-44a9-4afa-9723-d363ff4c4f42 req-3b1ed48f-f730-4cfe-a846-bea1f490ed45 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-694b83e7-44a9-4afa-9723-d363ff4c4f42 req-3b1ed48f-f730-4cfe-a846-bea1f490ed45 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-694b83e7-44a9-4afa-9723-d363ff4c4f42 req-3b1ed48f-f730-4cfe-a846-bea1f490ed45 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:53 user nova-compute[72929]: WARNING nova.compute.manager [req-694b83e7-44a9-4afa-9723-d363ff4c4f42 req-3b1ed48f-f730-4cfe-a846-bea1f490ed45 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state active and task_state resize_finish.
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:07:53 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:07:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[047bc787-345c-42bf-8431-75337510cab7]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:07:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:07:54 user nova-compute[72929]: DEBUG os_brick.utils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:07:54 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating existing volume attachment record: 16e2431c-a451-4d6e-971d-1d14dbd76294 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:07:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087675.683658, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Resumed (Lifecycle Event)
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:07:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance running successfully.
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Failed to set time: agent not configured {{(pid=72929) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d32f7722-fe85-4057-bcea-e16d7de4356a tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] finish_migration finished successfully. {{(pid=72929) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087675.6887555, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:07:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Started (Lifecycle Event)
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:07:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:07:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 22:07:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-536c3569-ab43-4b52-8561-cb77af1cf90e req-e7f0f768-5b7a-44c9-b75d-0427f2b87c27 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:07:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-536c3569-ab43-4b52-8561-cb77af1cf90e req-e7f0f768-5b7a-44c9-b75d-0427f2b87c27 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:07:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-536c3569-ab43-4b52-8561-cb77af1cf90e req-e7f0f768-5b7a-44c9-b75d-0427f2b87c27 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:07:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-536c3569-ab43-4b52-8561-cb77af1cf90e req-e7f0f768-5b7a-44c9-b75d-0427f2b87c27 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:07:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-536c3569-ab43-4b52-8561-cb77af1cf90e req-e7f0f768-5b7a-44c9-b75d-0427f2b87c27 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:07:56 user nova-compute[72929]: WARNING nova.compute.manager [req-536c3569-ab43-4b52-8561-cb77af1cf90e req-e7f0f768-5b7a-44c9-b75d-0427f2b87c27 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state resized and task_state None.
Aug 26 22:07:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:07:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJXNLxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:08:06 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:08:06 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:08:06 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d780c8-6f3a-47ae-9d24-bd6f576210b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:08:06 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca5a2ad-9299-430f-badd-864586191480]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2] added
Aug 26 22:08:06 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa64ba-8cd0-43c8-915f-7178beccd71b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e5db50-e2e9-404d-934f-f64c46e7a83f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJXNLxdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lJXNLxdc" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32e2ff3-2ede-4cae-9c44-e957705bc187]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lJXNLxdc'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef35d78-5d63-4743-aef8-9aacf4711bf9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2110e69b-4980-43b9-b8e5-64a7e6e9485b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:08:06 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:08:06 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:08:06 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:08:06 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:08:06 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:08:06 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:08:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b782e3fc-8027-40d6-aac5-3f71f27b86d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260]
Aug 26 22:08:07 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260] successful.
Aug 26 22:08:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[514dac78-2186-42cd-854e-01645b2d0fe6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f533593a-01e2-4122-8de1-3918cb8256d6]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:08:07 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:08:07 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:08:07 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:08:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:08:07 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:08:07 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:08:07 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:08:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[044ebac5-5541-4162-8f43-3f03a5e03c42]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJXNLxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26161306434623062', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161306434623062', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'flavor' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:08:08 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:08:08 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:08:08 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:08:08 user nova-compute[72929]:   <serial>3db27446-b610-4a9c-a04d-2045bc02d7c2</serial>
Aug 26 22:08:08 user nova-compute[72929]: </disk>
Aug 26 22:08:08 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:72:b9:27, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:08:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9c8b72a-3de5-4280-9647-ee4f59e0c0da tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.041s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Rescuing
Aug 26 22:08:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-6eb43701-ce1e-437e-a1fb-b069687136d6 req-7ed9496d-0c9a-4063-9a35-9a4aca8623ca service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6eb43701-ce1e-437e-a1fb-b069687136d6 req-7ed9496d-0c9a-4063-9a35-9a4aca8623ca service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6eb43701-ce1e-437e-a1fb-b069687136d6 req-7ed9496d-0c9a-4063-9a35-9a4aca8623ca service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6eb43701-ce1e-437e-a1fb-b069687136d6 req-7ed9496d-0c9a-4063-9a35-9a4aca8623ca service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-6eb43701-ce1e-437e-a1fb-b069687136d6 req-7ed9496d-0c9a-4063-9a35-9a4aca8623ca service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:10 user nova-compute[72929]: WARNING nova.compute.manager [req-6eb43701-ce1e-437e-a1fb-b069687136d6 req-7ed9496d-0c9a-4063-9a35-9a4aca8623ca service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state active and task_state rescuing.
Aug 26 22:08:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:08:10 user nova-compute[72929]: INFO nova.compute.claims [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Claim successful on node user
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:08:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance destroyed successfully.
Aug 26 22:08:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Attempting rescue
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72929) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:08:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Creating image(s)
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'trusted_certs' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.229s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue" returned: 0 in 0.049s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'migration_context' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.base [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<f16261bd-823d-4d47-9f2e-f33c0c03cfdf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Start _get_guest_xml network_info=[{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:72:b9:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'resources' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.base [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<f16261bd-823d-4d47-9f2e-f33c0c03cfdf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'numa_topology' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.base [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<f16261bd-823d-4d47-9f2e-f33c0c03cfdf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:08:11 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:11 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'vcpu_model' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.base [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<f16261bd-823d-4d47-9f2e-f33c0c03cfdf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1899681647',display_name='tempest-ServerRescueNegativeTestJSON-server-1899681647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1899681647',id=24,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmrnsPl9BCUz5gKi6NIGGc/WZfHCJpUkxNKj7/Gj13IimJduOfPMx5AAuMDtl6q2lQ2zDF7GwrYVa9bqba/vCby+DzGKrrDrrGXRxVHtS7xxJn2R2FxVmPEdZ2aAIFi5g==',key_name='tempest-keypair-1557050715',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:06:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-gj6izi2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:06:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c2dac68027a44a09a4deadab28f2981',uuid=f16261bd-823d-4d47-9f2e-f33c0c03cfdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:72:b9:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "vif_mac": "fa:16:3e:72:b9:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'pci_devices' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.objects.base [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Object Instance<f16261bd-823d-4d47-9f2e-f33c0c03cfdf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:08:11 user nova-compute[72929]:   <uuid>f16261bd-823d-4d47-9f2e-f33c0c03cfdf</uuid>
Aug 26 22:08:11 user nova-compute[72929]:   <name>instance-00000018</name>
Aug 26 22:08:11 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:08:11 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:08:11 user nova-compute[72929]:   <metadata>
Aug 26 22:08:11 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:08:11 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:08:11 user nova-compute[72929]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1899681647</nova:name>
Aug 26 22:08:11 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:08:11</nova:creationTime>
Aug 26 22:08:11 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:08:11 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:08:11 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:08:11 user nova-compute[72929]:       <nova:owner>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:user uuid="6c2dac68027a44a09a4deadab28f2981">tempest-ServerRescueNegativeTestJSON-26026282-project-member</nova:user>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:project uuid="4e6d14fc09c246779e46e7c816370a1c">tempest-ServerRescueNegativeTestJSON-26026282</nova:project>
Aug 26 22:08:11 user nova-compute[72929]:       </nova:owner>
Aug 26 22:08:11 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:08:11 user nova-compute[72929]:       <nova:ports>
Aug 26 22:08:11 user nova-compute[72929]:         <nova:port uuid="30fff5ce-e634-4d69-bba7-e77ac1190ee2">
Aug 26 22:08:11 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 22:08:11 user nova-compute[72929]:         </nova:port>
Aug 26 22:08:11 user nova-compute[72929]:       </nova:ports>
Aug 26 22:08:11 user nova-compute[72929]:     </nova:instance>
Aug 26 22:08:11 user nova-compute[72929]:   </metadata>
Aug 26 22:08:11 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:08:11 user nova-compute[72929]:     <system>
Aug 26 22:08:11 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:08:11 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:08:11 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:08:11 user nova-compute[72929]:       <entry name="serial">f16261bd-823d-4d47-9f2e-f33c0c03cfdf</entry>
Aug 26 22:08:11 user nova-compute[72929]:       <entry name="uuid">f16261bd-823d-4d47-9f2e-f33c0c03cfdf</entry>
Aug 26 22:08:11 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:08:11 user nova-compute[72929]:     </system>
Aug 26 22:08:11 user nova-compute[72929]:   </sysinfo>
Aug 26 22:08:11 user nova-compute[72929]:   <os>
Aug 26 22:08:11 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:08:11 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:08:11 user nova-compute[72929]:   </os>
Aug 26 22:08:11 user nova-compute[72929]:   <features>
Aug 26 22:08:11 user nova-compute[72929]:     <acpi/>
Aug 26 22:08:11 user nova-compute[72929]:     <apic/>
Aug 26 22:08:11 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:08:11 user nova-compute[72929]:   </features>
Aug 26 22:08:11 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:08:11 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:08:11 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:08:11 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:08:11 user nova-compute[72929]:   </clock>
Aug 26 22:08:11 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:08:11 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:08:11 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:08:11 user nova-compute[72929]:   </cpu>
Aug 26 22:08:11 user nova-compute[72929]:   <devices>
Aug 26 22:08:11 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:08:11 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:08:11 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue"/>
Aug 26 22:08:11 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:08:11 user nova-compute[72929]:     </disk>
Aug 26 22:08:11 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:08:11 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:08:11 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk"/>
Aug 26 22:08:11 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:08:11 user nova-compute[72929]:     </disk>
Aug 26 22:08:11 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:08:11 user nova-compute[72929]:       <mac address="fa:16:3e:72:b9:27"/>
Aug 26 22:08:11 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:08:11 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:08:11 user nova-compute[72929]:       <target dev="tap30fff5ce-e6"/>
Aug 26 22:08:11 user nova-compute[72929]:     </interface>
Aug 26 22:08:11 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:08:11 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/console.log" append="off"/>
Aug 26 22:08:11 user nova-compute[72929]:     </serial>
Aug 26 22:08:11 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:08:11 user nova-compute[72929]:     <video>
Aug 26 22:08:11 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:08:11 user nova-compute[72929]:     </video>
Aug 26 22:08:11 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:08:11 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:08:11 user nova-compute[72929]:     </rng>
Aug 26 22:08:11 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:08:11 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:08:11 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:08:11 user nova-compute[72929]:     </memballoon>
Aug 26 22:08:11 user nova-compute[72929]:   </devices>
Aug 26 22:08:11 user nova-compute[72929]: </domain>
Aug 26 22:08:11 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:08:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance destroyed successfully.
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.967s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.589s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] No VIF found with MAC fa:16:3e:72:b9:27, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:08:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:08:11 user nova-compute[72929]: INFO nova.compute.claims [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Claim successful on node user
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:08:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.policy [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ef1bea627245e29428b442787db7b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a593fe9fb7a442f08880ecd2fab42df6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:08:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Creating image(s)
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "/opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.648s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk 1073741824" returned: 0 in 0.068s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.policy [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ad44b98452d41a89c4d14747f2a6036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9b1c93b18e2422783401f0c73fe6390', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:08:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Creating image(s)
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.238s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:08:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-b33a6b67-8c7b-430e-8253-b78aeec7f4f5 req-88de81cd-51b2-4fca-ab3c-976062b60e47 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b33a6b67-8c7b-430e-8253-b78aeec7f4f5 req-88de81cd-51b2-4fca-ab3c-976062b60e47 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b33a6b67-8c7b-430e-8253-b78aeec7f4f5 req-88de81cd-51b2-4fca-ab3c-976062b60e47 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b33a6b67-8c7b-430e-8253-b78aeec7f4f5 req-88de81cd-51b2-4fca-ab3c-976062b60e47 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-b33a6b67-8c7b-430e-8253-b78aeec7f4f5 req-88de81cd-51b2-4fca-ab3c-976062b60e47 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:13 user nova-compute[72929]: WARNING nova.compute.manager [req-b33a6b67-8c7b-430e-8253-b78aeec7f4f5 req-88de81cd-51b2-4fca-ab3c-976062b60e47 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state active and task_state rescuing.
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Cannot resize image /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Ensure instance console log exists: /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Successfully created port: 69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk 1073741824" returned: 0 in 0.074s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Successfully created port: 36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Cannot resize image /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Ensure instance console log exists: /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Successfully updated port: 36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing instance network info cache due to event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Successfully updated port: 69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquired lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance network_info: |[{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Start _get_guest_xml network_info=[{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:08:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-307271181',display_name='tempest-ServerStableDeviceRescueTest-server-307271181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-307271181',id=28,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaQrMpX5D3/D0f5rMRJs05UxwQ4nOPNwd8wSykXIZBFClehKfGl3vJt5kyJy81nVsRMnLuoYuKgJOKXGIqk89oUeud5z/WKozXn+ryW8yrqW1gFfILXb152Y/ToR42/eQ==',key_name='tempest-keypair-994409064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9b1c93b18e2422783401f0c73fe6390',ramdisk_id='',reservation_id='r-x02l0mvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1771134667',owner_user_name='tempest-ServerStableDeviceRescueTest-1771134667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ad44b98452d41a89c4d14747f2a6036',uuid=51939e0e-26e5-4a6c-9f85-a294036fd456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converting VIF {"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.objects.instance [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'pci_devices' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updating instance_info_cache with network_info: [{"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:08:14 user nova-compute[72929]:   <uuid>51939e0e-26e5-4a6c-9f85-a294036fd456</uuid>
Aug 26 22:08:14 user nova-compute[72929]:   <name>instance-0000001c</name>
Aug 26 22:08:14 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:08:14 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:08:14 user nova-compute[72929]:   <metadata>
Aug 26 22:08:14 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:08:14 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:08:14 user nova-compute[72929]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-307271181</nova:name>
Aug 26 22:08:14 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:08:14</nova:creationTime>
Aug 26 22:08:14 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:08:14 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:08:14 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:08:14 user nova-compute[72929]:       <nova:owner>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:user uuid="2ad44b98452d41a89c4d14747f2a6036">tempest-ServerStableDeviceRescueTest-1771134667-project-member</nova:user>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:project uuid="d9b1c93b18e2422783401f0c73fe6390">tempest-ServerStableDeviceRescueTest-1771134667</nova:project>
Aug 26 22:08:14 user nova-compute[72929]:       </nova:owner>
Aug 26 22:08:14 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:08:14 user nova-compute[72929]:       <nova:ports>
Aug 26 22:08:14 user nova-compute[72929]:         <nova:port uuid="36a6c019-2580-4d4b-8223-6ec70a6c0046">
Aug 26 22:08:14 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:08:14 user nova-compute[72929]:         </nova:port>
Aug 26 22:08:14 user nova-compute[72929]:       </nova:ports>
Aug 26 22:08:14 user nova-compute[72929]:     </nova:instance>
Aug 26 22:08:14 user nova-compute[72929]:   </metadata>
Aug 26 22:08:14 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:08:14 user nova-compute[72929]:     <system>
Aug 26 22:08:14 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:08:14 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:08:14 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:08:14 user nova-compute[72929]:       <entry name="serial">51939e0e-26e5-4a6c-9f85-a294036fd456</entry>
Aug 26 22:08:14 user nova-compute[72929]:       <entry name="uuid">51939e0e-26e5-4a6c-9f85-a294036fd456</entry>
Aug 26 22:08:14 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:08:14 user nova-compute[72929]:     </system>
Aug 26 22:08:14 user nova-compute[72929]:   </sysinfo>
Aug 26 22:08:14 user nova-compute[72929]:   <os>
Aug 26 22:08:14 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:08:14 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:08:14 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:08:14 user nova-compute[72929]:   </os>
Aug 26 22:08:14 user nova-compute[72929]:   <features>
Aug 26 22:08:14 user nova-compute[72929]:     <acpi/>
Aug 26 22:08:14 user nova-compute[72929]:     <apic/>
Aug 26 22:08:14 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:08:14 user nova-compute[72929]:   </features>
Aug 26 22:08:14 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:08:14 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:08:14 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:08:14 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:08:14 user nova-compute[72929]:   </clock>
Aug 26 22:08:14 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:08:14 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:08:14 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:08:14 user nova-compute[72929]:   </cpu>
Aug 26 22:08:14 user nova-compute[72929]:   <devices>
Aug 26 22:08:14 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:08:14 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:08:14 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk"/>
Aug 26 22:08:14 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:08:14 user nova-compute[72929]:     </disk>
Aug 26 22:08:14 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:08:14 user nova-compute[72929]:       <mac address="fa:16:3e:8a:10:02"/>
Aug 26 22:08:14 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:08:14 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:08:14 user nova-compute[72929]:       <target dev="tap36a6c019-25"/>
Aug 26 22:08:14 user nova-compute[72929]:     </interface>
Aug 26 22:08:14 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:08:14 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/console.log" append="off"/>
Aug 26 22:08:14 user nova-compute[72929]:     </serial>
Aug 26 22:08:14 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:08:14 user nova-compute[72929]:     <video>
Aug 26 22:08:14 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:08:14 user nova-compute[72929]:     </video>
Aug 26 22:08:14 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:08:14 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:08:14 user nova-compute[72929]:     </rng>
Aug 26 22:08:14 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:08:14 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:08:14 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:08:14 user nova-compute[72929]:     </memballoon>
Aug 26 22:08:14 user nova-compute[72929]:   </devices>
Aug 26 22:08:14 user nova-compute[72929]: </domain>
Aug 26 22:08:14 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-307271181',display_name='tempest-ServerStableDeviceRescueTest-server-307271181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-307271181',id=28,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaQrMpX5D3/D0f5rMRJs05UxwQ4nOPNwd8wSykXIZBFClehKfGl3vJt5kyJy81nVsRMnLuoYuKgJOKXGIqk89oUeud5z/WKozXn+ryW8yrqW1gFfILXb152Y/ToR42/eQ==',key_name='tempest-keypair-994409064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9b1c93b18e2422783401f0c73fe6390',ramdisk_id='',reservation_id='r-x02l0mvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1771134667',owner_user_name='tempest-ServerStableDeviceRescueTest-1771134667-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ad44b98452d41a89c4d14747f2a6036',uuid=51939e0e-26e5-4a6c-9f85-a294036fd456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converting VIF {"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG os_vif [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Releasing lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Instance network_info: |[{"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Start _get_guest_xml network_info=[{"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36a6c019-25, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36a6c019-25, col_values=(('external_ids', {'iface-id': '36a6c019-2580-4d4b-8223-6ec70a6c0046', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:10:02', 'vm-uuid': '51939e0e-26e5-4a6c-9f85-a294036fd456'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:08:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:14 user nova-compute[72929]: INFO os_vif [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25')
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1851072362',display_name='tempest-AttachVolumeNegativeTest-server-1851072362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1851072362',id=27,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNe6x7FOuZJWYsiAY0CZcEzEej+ucCcEmodTjiP6Y2FpCSoNfYZU48pdhOwdqq3C1OHBayCXEmgAFHVy+9zJ7rUFcSrZujpGWi29xWBDq/1LDxMfyycGSbju440pY9FAng==',key_name='tempest-keypair-1645245032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-k0x04n4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=9cfedc10-54d5-4ce0-8d15-9f0d23361489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:08:14 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cfedc10-54d5-4ce0-8d15-9f0d23361489 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:08:15 user nova-compute[72929]:   <uuid>9cfedc10-54d5-4ce0-8d15-9f0d23361489</uuid>
Aug 26 22:08:15 user nova-compute[72929]:   <name>instance-0000001b</name>
Aug 26 22:08:15 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:08:15 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:08:15 user nova-compute[72929]:   <metadata>
Aug 26 22:08:15 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:08:15 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:08:15 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1851072362</nova:name>
Aug 26 22:08:15 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:08:14</nova:creationTime>
Aug 26 22:08:15 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:08:15 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:08:15 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:08:15 user nova-compute[72929]:       <nova:owner>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:user uuid="64ef1bea627245e29428b442787db7b7">tempest-AttachVolumeNegativeTest-600362177-project-member</nova:user>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:project uuid="a593fe9fb7a442f08880ecd2fab42df6">tempest-AttachVolumeNegativeTest-600362177</nova:project>
Aug 26 22:08:15 user nova-compute[72929]:       </nova:owner>
Aug 26 22:08:15 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:08:15 user nova-compute[72929]:       <nova:ports>
Aug 26 22:08:15 user nova-compute[72929]:         <nova:port uuid="69f58484-9f9b-4835-b269-644441508b83">
Aug 26 22:08:15 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:08:15 user nova-compute[72929]:         </nova:port>
Aug 26 22:08:15 user nova-compute[72929]:       </nova:ports>
Aug 26 22:08:15 user nova-compute[72929]:     </nova:instance>
Aug 26 22:08:15 user nova-compute[72929]:   </metadata>
Aug 26 22:08:15 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:08:15 user nova-compute[72929]:     <system>
Aug 26 22:08:15 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:08:15 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:08:15 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:08:15 user nova-compute[72929]:       <entry name="serial">9cfedc10-54d5-4ce0-8d15-9f0d23361489</entry>
Aug 26 22:08:15 user nova-compute[72929]:       <entry name="uuid">9cfedc10-54d5-4ce0-8d15-9f0d23361489</entry>
Aug 26 22:08:15 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:08:15 user nova-compute[72929]:     </system>
Aug 26 22:08:15 user nova-compute[72929]:   </sysinfo>
Aug 26 22:08:15 user nova-compute[72929]:   <os>
Aug 26 22:08:15 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:08:15 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:08:15 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:08:15 user nova-compute[72929]:   </os>
Aug 26 22:08:15 user nova-compute[72929]:   <features>
Aug 26 22:08:15 user nova-compute[72929]:     <acpi/>
Aug 26 22:08:15 user nova-compute[72929]:     <apic/>
Aug 26 22:08:15 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:08:15 user nova-compute[72929]:   </features>
Aug 26 22:08:15 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:08:15 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:08:15 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:08:15 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:08:15 user nova-compute[72929]:   </clock>
Aug 26 22:08:15 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:08:15 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:08:15 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:08:15 user nova-compute[72929]:   </cpu>
Aug 26 22:08:15 user nova-compute[72929]:   <devices>
Aug 26 22:08:15 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:08:15 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:08:15 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk"/>
Aug 26 22:08:15 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:08:15 user nova-compute[72929]:     </disk>
Aug 26 22:08:15 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:08:15 user nova-compute[72929]:       <mac address="fa:16:3e:4a:39:b4"/>
Aug 26 22:08:15 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:08:15 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:08:15 user nova-compute[72929]:       <target dev="tap69f58484-9f"/>
Aug 26 22:08:15 user nova-compute[72929]:     </interface>
Aug 26 22:08:15 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:08:15 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/console.log" append="off"/>
Aug 26 22:08:15 user nova-compute[72929]:     </serial>
Aug 26 22:08:15 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:08:15 user nova-compute[72929]:     <video>
Aug 26 22:08:15 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:08:15 user nova-compute[72929]:     </video>
Aug 26 22:08:15 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:08:15 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:08:15 user nova-compute[72929]:     </rng>
Aug 26 22:08:15 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:08:15 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:08:15 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:08:15 user nova-compute[72929]:     </memballoon>
Aug 26 22:08:15 user nova-compute[72929]:   </devices>
Aug 26 22:08:15 user nova-compute[72929]: </domain>
Aug 26 22:08:15 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1851072362',display_name='tempest-AttachVolumeNegativeTest-server-1851072362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1851072362',id=27,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNe6x7FOuZJWYsiAY0CZcEzEej+ucCcEmodTjiP6Y2FpCSoNfYZU48pdhOwdqq3C1OHBayCXEmgAFHVy+9zJ7rUFcSrZujpGWi29xWBDq/1LDxMfyycGSbju440pY9FAng==',key_name='tempest-keypair-1645245032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-k0x04n4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=9cfedc10-54d5-4ce0-8d15-9f0d23361489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG os_vif [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69f58484-9f, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69f58484-9f, col_values=(('external_ids', {'iface-id': '69f58484-9f9b-4835-b269-644441508b83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:39:b4', 'vm-uuid': '9cfedc10-54d5-4ce0-8d15-9f0d23361489'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No VIF found with MAC fa:16:3e:8a:10:02, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:15 user nova-compute[72929]: INFO os_vif [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f')
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:4a:39:b4, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:15 user nova-compute[72929]: WARNING nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state active and task_state rescuing.
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:15 user nova-compute[72929]: WARNING nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state active and task_state rescuing.
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-changed-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Refreshing instance network info cache due to event network-changed-69f58484-9f9b-4835-b269-644441508b83. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Acquiring lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Acquired lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Refreshing network info cache for port 69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updated VIF entry in instance network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-df6b6839-28fa-4c4d-b1c7-953d0a014fa8 req-5c6d1065-16fe-4929-b784-ea320dd2c28c service nova] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for f16261bd-823d-4d47-9f2e-f33c0c03cfdf due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087695.518193, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Resumed (Lifecycle Event)
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5cf81438-ab36-43e6-9871-9fa9150ed16a tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087695.52168, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Started (Lifecycle Event)
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updated VIF entry in instance network info cache for port 69f58484-9f9b-4835-b269-644441508b83. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG nova.network.neutron [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updating instance_info_cache with network_info: [{"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-aeab4aeb-11ef-4363-89fb-917a9b381432 req-0661852c-fe7e-4490-89da-43e40ae2afd7 service nova] Releasing lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-e03246f2-8eed-49d5-a7b0-ca82180ef537 req-f27348e5-4d54-42fa-9758-cfd8c05a4d12 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e03246f2-8eed-49d5-a7b0-ca82180ef537 req-f27348e5-4d54-42fa-9758-cfd8c05a4d12 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e03246f2-8eed-49d5-a7b0-ca82180ef537 req-f27348e5-4d54-42fa-9758-cfd8c05a4d12 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e03246f2-8eed-49d5-a7b0-ca82180ef537 req-f27348e5-4d54-42fa-9758-cfd8c05a4d12 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-e03246f2-8eed-49d5-a7b0-ca82180ef537 req-f27348e5-4d54-42fa-9758-cfd8c05a4d12 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:17 user nova-compute[72929]: WARNING nova.compute.manager [req-e03246f2-8eed-49d5-a7b0-ca82180ef537 req-f27348e5-4d54-42fa-9758-cfd8c05a4d12 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state building and task_state spawning.
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:19 user nova-compute[72929]: WARNING nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state building and task_state spawning.
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] No waiting events found dispatching network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:19 user nova-compute[72929]: WARNING nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received unexpected event network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 for instance with vm_state building and task_state spawning.
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] No waiting events found dispatching network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:19 user nova-compute[72929]: WARNING nova.compute.manager [req-4c963f7e-ebb5-493f-b993-56b1bb38df41 req-e3a57c59-d0be-4132-aaae-0e660d709dfd service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received unexpected event network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 for instance with vm_state building and task_state spawning.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087700.3999722, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Resumed (Lifecycle Event)
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance spawned successfully.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087700.413956, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Started (Lifecycle Event)
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Instance spawned successfully.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087700.5157263, 9cfedc10-54d5-4ce0-8d15-9f0d23361489 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] VM Resumed (Lifecycle Event)
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Took 7.73 seconds to spawn the instance on the hypervisor.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087700.5167458, 9cfedc10-54d5-4ce0-8d15-9f0d23361489 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] VM Started (Lifecycle Event)
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Took 9.63 seconds to build instance.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-677675d4-3730-49bf-a0b1-8c0f1fe38743 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.801s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Took 8.60 seconds to spawn the instance on the hypervisor.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:20 user nova-compute[72929]: INFO nova.compute.manager [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Took 9.99 seconds to build instance.
Aug 26 22:08:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1b21e833-9739-42a8-a92e-83f13cfc0e5f tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.140s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'flavor' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.525s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:27 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:27 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7033MB free_disk=24.200035095214844GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Applying migration context for instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 as it has an incoming, in-progress migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39. Migration status is finished {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 22:08:28 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating resource usage from migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:28 user nova-compute[72929]: INFO nova.compute.manager [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Attaching volume d7f6a3ee-28c4-42ce-a783-987fd66da8ac to /dev/vdb
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3d4b6c0c-916e-4698-9add-32f3e85216cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG os_brick.utils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c0e24-f9ec-4950-aa31-d9b076c67e3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7433c410-dc0e-49d8-9e7d-22a90e15eb2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde03a4b-1fa9-4d36-bff1-cc48385b5d8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e14132c-25ae-4a6b-8d98-2aa5e8f6e6a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:08:28 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfdacb5-aadf-4677-8f81-0e16743c5c4c]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG os_brick.utils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating existing volume attachment record: 028bf344-52c6-4715-aeec-458e5ca77394 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.984s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating instance_info_cache with network_info: [{"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-3db3d467-df63-4ea0-951b-4eee4460980f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:08:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:08:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:08:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:08:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:08:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:37 user nova-compute[72929]: INFO nova.compute.manager [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Detaching volume 16a42b1a-1527-46b4-9e96-3c16f6c0c981
Aug 26 22:08:37 user nova-compute[72929]: INFO nova.virt.block_device [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Attempting to driver detach volume 16a42b1a-1527-46b4-9e96-3c16f6c0c981 from mountpoint /dev/vdb
Aug 26 22:08:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Attempting to detach device vdb from instance a0172f33-06bb-404d-8fb0-c88927e84bdd from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:08:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:08:37 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:08:37 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:08:37 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:08:37 user nova-compute[72929]:   <serial>16a42b1a-1527-46b4-9e96-3c16f6c0c981</serial>
Aug 26 22:08:37 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:08:37 user nova-compute[72929]: </disk>
Aug 26 22:08:37 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:08:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully detached device vdb from instance a0172f33-06bb-404d-8fb0-c88927e84bdd from the persistent domain config.
Aug 26 22:08:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0172f33-06bb-404d-8fb0-c88927e84bdd from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:08:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:08:37 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:08:37 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:08:37 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:08:37 user nova-compute[72929]:   <serial>16a42b1a-1527-46b4-9e96-3c16f6c0c981</serial>
Aug 26 22:08:37 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:08:37 user nova-compute[72929]: </disk>
Aug 26 22:08:37 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087718.3427145, a0172f33-06bb-404d-8fb0-c88927e84bdd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:08:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully detached device vdb from instance a0172f33-06bb-404d-8fb0-c88927e84bdd from the live domain config.
Aug 26 22:08:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBMpaOGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:08:38 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc6f505-443f-4ebf-a8f2-f89cdc957a19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f8ee21-c948-4e55-8df6-f50b415eb6ea]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:08:38 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:08:38 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:08:38 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:08:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 (non-flash)
Aug 26 22:08:38 user nova-compute[72929]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:08:38 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:08:38 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:08:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803bc040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0765693-0afd-41c7-ba15-d38dec083f58]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7c0113-2e61-4d19-bc1c-380f42f5f1cf]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aafe89-b0db-4813-83a0-009f06d61fe4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958f67c-636f-4947-a433-554a8bf73b0b]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9c8bb-5f8f-4ca9-91db-ce6f0bd01f09]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dea85d-37ac-440c-8d63-aca0385717d3]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260]
Aug 26 22:08:38 user nova-compute[72929]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981, portal: 172.16.0.220,3260] successful.
Aug 26 22:08:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ccbeb-38f2-4bad-bcba-5df4597ad649]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== disconnect_volume: return (277ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:08:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5ffba22b-e9b1-411d-aac1-5a0b6780df45 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72929) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 26 22:08:39 user nova-compute[72929]: DEBUG nova.objects.instance [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-88181135-51aa-485e-864e-a8ebbc46c189 req-66b962c6-c966-479f-b39a-7dd4817bb95a service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-88181135-51aa-485e-864e-a8ebbc46c189 req-66b962c6-c966-479f-b39a-7dd4817bb95a service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-88181135-51aa-485e-864e-a8ebbc46c189 req-66b962c6-c966-479f-b39a-7dd4817bb95a service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-88181135-51aa-485e-864e-a8ebbc46c189 req-66b962c6-c966-479f-b39a-7dd4817bb95a service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-88181135-51aa-485e-864e-a8ebbc46c189 req-66b962c6-c966-479f-b39a-7dd4817bb95a service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:40 user nova-compute[72929]: WARNING nova.compute.manager [req-88181135-51aa-485e-864e-a8ebbc46c189 req-66b962c6-c966-479f-b39a-7dd4817bb95a service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state active and task_state powering-off.
Aug 26 22:08:40 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance destroyed successfully.
Aug 26 22:08:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-71c97e2b-e3c7-4404-b6aa-eadd55576d93 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.909s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:41 user nova-compute[72929]: INFO nova.compute.manager [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Terminating instance
Aug 26 22:08:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-d000fe27-85fa-4880-8fae-29ac22aeb74b req-b60eee75-a978-4d6d-9e68-16130e961332 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-vif-unplugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d000fe27-85fa-4880-8fae-29ac22aeb74b req-b60eee75-a978-4d6d-9e68-16130e961332 service nova] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d000fe27-85fa-4880-8fae-29ac22aeb74b req-b60eee75-a978-4d6d-9e68-16130e961332 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d000fe27-85fa-4880-8fae-29ac22aeb74b req-b60eee75-a978-4d6d-9e68-16130e961332 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-d000fe27-85fa-4880-8fae-29ac22aeb74b req-b60eee75-a978-4d6d-9e68-16130e961332 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] No waiting events found dispatching network-vif-unplugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-d000fe27-85fa-4880-8fae-29ac22aeb74b req-b60eee75-a978-4d6d-9e68-16130e961332 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-vif-unplugged-e4225404-e773-4ca8-bb21-95109f2d8969 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Instance destroyed successfully.
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lazy-loading 'resources' on Instance uuid d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1779389361',display_name='tempest-ServersNegativeTestJSON-server-1779389361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1779389361',id=25,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:06:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c177bf6e804c3292dab6eaf860934d',ramdisk_id='',reservation_id='r-gufufmua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-789296540',owner_user_name='tempest-ServersNegativeTestJSON-789296540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:06:59Z,user_data=None,user_id='9c667638141d429e925ecd38af6423fc',uuid=d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converting VIF {"id": "e4225404-e773-4ca8-bb21-95109f2d8969", "address": "fa:16:3e:06:81:42", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4225404-e7", "ovs_interfaceid": "e4225404-e773-4ca8-bb21-95109f2d8969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG os_vif [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4225404-e7, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:42 user nova-compute[72929]: INFO os_vif [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:81:42,bridge_name='br-int',has_traffic_filtering=True,id=e4225404-e773-4ca8-bb21-95109f2d8969,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4225404-e7')
Aug 26 22:08:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Deleting instance files /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc_del
Aug 26 22:08:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Deletion of /opt/stack/data/nova/instances/d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc_del complete
Aug 26 22:08:42 user nova-compute[72929]: INFO nova.compute.manager [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c9af01d4-e98e-4832-bb79-0c8fe829dd36 req-a02af6dc-e3fa-4799-be47-26446733966b service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c9af01d4-e98e-4832-bb79-0c8fe829dd36 req-a02af6dc-e3fa-4799-be47-26446733966b service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c9af01d4-e98e-4832-bb79-0c8fe829dd36 req-a02af6dc-e3fa-4799-be47-26446733966b service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c9af01d4-e98e-4832-bb79-0c8fe829dd36 req-a02af6dc-e3fa-4799-be47-26446733966b service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-c9af01d4-e98e-4832-bb79-0c8fe829dd36 req-a02af6dc-e3fa-4799-be47-26446733966b service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:42 user nova-compute[72929]: WARNING nova.compute.manager [req-c9af01d4-e98e-4832-bb79-0c8fe829dd36 req-a02af6dc-e3fa-4799-be47-26446733966b service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state stopped and task_state None.
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.volume.cinder [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Update attachment failed for attachment 028bf344-52c6-4715-aeec-458e5ca77394. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 was not found.).). (HTTP 500) (Request-ID: req-090b3db6-182c-4638-b6d0-8dfada0c0319) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 was not found.).). (HTTP 500) (Request-ID: req-090b3db6-182c-4638-b6d0-8dfada0c0319)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Failed to attach d7f6a3ee-28c4-42ce-a783-987fd66da8ac at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 was not found.).). (HTTP 500) (Request-ID: req-090b3db6-182c-4638-b6d0-8dfada0c0319)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Traceback (most recent call last):
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     ret_val = method(obj, context, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     self._do_attach(context, instance, volume, volume_api,
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     self._volume_attach(context, volume, connector, instance,
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     connection_info = volume_api.attachment_update(
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     res = method(self, ctx, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     with excutils.save_and_reraise_exception():
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     self.force_reraise()
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     raise self.value
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     return method.func(obj, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     resp = self._update('/attachments/%s' % id, body)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     return self.request(url, method, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f]     raise exceptions.from_response(resp, body)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 was not found.).). (HTTP 500) (Request-ID: req-090b3db6-182c-4638-b6d0-8dfada0c0319)
Aug 26 22:08:42 user nova-compute[72929]: ERROR nova.compute.manager [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] 
Aug 26 22:08:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.380s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server [None req-f3098e7a-02be-4a59-89bf-fb3dab089f10 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 was not found.).). (HTTP 500) (Request-ID: req-090b3db6-182c-4638-b6d0-8dfada0c0319)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:d7f6a3ee-28c4-42ce-a783-987fd66da8ac/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:16a42b1a-1527-46b4-9e96-3c16f6c0c981 was not found.).). (HTTP 500) (Request-ID: req-090b3db6-182c-4638-b6d0-8dfada0c0319)
Aug 26 22:08:42 user nova-compute[72929]: ERROR oslo_messaging.rpc.server 
Aug 26 22:08:43 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:43 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Took 0.60 seconds to deallocate network for instance.
Aug 26 22:08:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-8056f1dc-7655-42a9-bd2a-afab86eff173 req-b0063cdf-992c-4003-97aa-50ba06a963db service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-vif-deleted-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:43 user nova-compute[72929]: INFO nova.compute.manager [req-8056f1dc-7655-42a9-bd2a-afab86eff173 req-b0063cdf-992c-4003-97aa-50ba06a963db service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Neutron deleted interface e4225404-e773-4ca8-bb21-95109f2d8969; detaching it from the instance and deleting it from the info cache
Aug 26 22:08:43 user nova-compute[72929]: DEBUG nova.network.neutron [req-8056f1dc-7655-42a9-bd2a-afab86eff173 req-b0063cdf-992c-4003-97aa-50ba06a963db service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-8056f1dc-7655-42a9-bd2a-afab86eff173 req-b0063cdf-992c-4003-97aa-50ba06a963db service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Detach interface failed, port_id=e4225404-e773-4ca8-bb21-95109f2d8969, reason: Instance d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:08:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:43 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Deleted allocations for instance d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc
Aug 26 22:08:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b19f5d9a-d481-4a82-9b82-84cfa6a80cd2 tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.929s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-64c22a13-8a9c-4a8a-8b9a-22c288e785f0 req-0446a64d-2143-4ae6-aa79-c8faa9b0f999 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received event network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-64c22a13-8a9c-4a8a-8b9a-22c288e785f0 req-0446a64d-2143-4ae6-aa79-c8faa9b0f999 service nova] Acquiring lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-64c22a13-8a9c-4a8a-8b9a-22c288e785f0 req-0446a64d-2143-4ae6-aa79-c8faa9b0f999 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-64c22a13-8a9c-4a8a-8b9a-22c288e785f0 req-0446a64d-2143-4ae6-aa79-c8faa9b0f999 service nova] Lock "d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-64c22a13-8a9c-4a8a-8b9a-22c288e785f0 req-0446a64d-2143-4ae6-aa79-c8faa9b0f999 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] No waiting events found dispatching network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:08:44 user nova-compute[72929]: WARNING nova.compute.manager [req-64c22a13-8a9c-4a8a-8b9a-22c288e785f0 req-0446a64d-2143-4ae6-aa79-c8faa9b0f999 service nova] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Received unexpected event network-vif-plugged-e4225404-e773-4ca8-bb21-95109f2d8969 for instance with vm_state deleted and task_state None.
Aug 26 22:08:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:54 user nova-compute[72929]: INFO nova.compute.manager [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Unshelving
Aug 26 22:08:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:54 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'pci_requests' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:54 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'numa_topology' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:54 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:08:54 user nova-compute[72929]: INFO nova.compute.claims [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Claim successful on node user
Aug 26 22:08:55 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:08:55 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:08:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:55 user nova-compute[72929]: INFO nova.network.neutron [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating port 31f5f5c0-90be-4968-af17-b2fa7ea45f29 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 22:08:55 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087720.8370926, a0172f33-06bb-404d-8fb0-c88927e84bdd => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:55 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Stopped (Lifecycle Event)
Aug 26 22:08:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-51d90a85-00e0-45ac-98a3-3a8ea6e4f924 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-51d90a85-00e0-45ac-98a3-3a8ea6e4f924 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing instance network info cache due to event network-changed-31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] Acquiring lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087722.3108504, d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:08:57 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] VM Stopped (Lifecycle Event)
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-626f4477-4930-4a8e-9ca1-8be4c726c1ea None None] [instance: d6b0a513-b9b7-41c7-9362-bfbf5a5f1bdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.network.neutron [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:08:57 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Creating image(s)
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'trusted_certs' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] Acquired lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Refreshing network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG nova.objects.base [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<387ba104-895e-433c-a100-51b98acf8c15> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "146f5d65494e58ae0ce01f23d3b4f54e2ff201e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "146f5d65494e58ae0ce01f23d3b4f54e2ff201e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.part --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG nova.virt.images [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] 143449c1-2485-419f-864c-75bab561a3e9 was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.part /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG nova.network.neutron [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updated VIF entry in instance network info cache for port 31f5f5c0-90be-4968-af17-b2fa7ea45f29. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG nova.network.neutron [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.part /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.converted" returned: 0 in 0.237s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2c8e5212-f3f7-48b0-b90e-de46ba3b0837 req-8cab40f9-b4de-41c4-9a3f-be499642ccff service nova] Releasing lock "refresh_cache-387ba104-895e-433c-a100-51b98acf8c15" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "146f5d65494e58ae0ce01f23d3b4f54e2ff201e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.881s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "146f5d65494e58ae0ce01f23d3b4f54e2ff201e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "146f5d65494e58ae0ce01f23d3b4f54e2ff201e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:08:59 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2,backing_fmt=raw /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2,backing_fmt=raw /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk 1073741824" returned: 0 in 0.053s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "146f5d65494e58ae0ce01f23d3b4f54e2ff201e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 --force-share --output=json" returned: 0 in 0.223s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'migration_context' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG nova.objects.base [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<387ba104-895e-433c-a100-51b98acf8c15> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:09:00 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Rebasing disk image.
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:00 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 -F raw /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 -F raw /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk" returned: 0 in 2.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Ensure instance console log exists: /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Start _get_guest_xml network_info=[{"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cc7c13334d92bcbf51d001860f1ab9fc',container_format='bare',created_at=2023-08-26T22:07:02Z,direct_url=<?>,disk_format='qcow2',id=143449c1-2485-419f-864c-75bab561a3e9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-738784921-shelved',owner='22dd3139d0af4e319ee02bff3155650b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T22:07:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:09:02 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:02 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cc7c13334d92bcbf51d001860f1ab9fc',container_format='bare',created_at=2023-08-26T22:07:02Z,direct_url=<?>,disk_format='qcow2',id=143449c1-2485-419f-864c-75bab561a3e9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-738784921-shelved',owner='22dd3139d0af4e319ee02bff3155650b',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T22:07:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.objects.base [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<387ba104-895e-433c-a100-51b98acf8c15> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-738784921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-738784921',id=23,image_ref='143449c1-2485-419f-864c-75bab561a3e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1698526643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-ujoxx46c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member',shelved_at='2023-08-26T22:07:08.734311',shelved_host='user',shelved_image_id='143449c1-2485-419f-864c-75bab561a3e9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=387ba104-895e-433c-a100-51b98acf8c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.objects.instance [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'pci_devices' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.objects.base [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Object Instance<387ba104-895e-433c-a100-51b98acf8c15> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:09:02 user nova-compute[72929]:   <uuid>387ba104-895e-433c-a100-51b98acf8c15</uuid>
Aug 26 22:09:02 user nova-compute[72929]:   <name>instance-00000017</name>
Aug 26 22:09:02 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:09:02 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:09:02 user nova-compute[72929]:   <metadata>
Aug 26 22:09:02 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:09:02 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:09:02 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-738784921</nova:name>
Aug 26 22:09:02 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:09:02</nova:creationTime>
Aug 26 22:09:02 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:09:02 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:09:02 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:09:02 user nova-compute[72929]:       <nova:owner>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:user uuid="cf32662e1a4e466781518d4fdd63cb76">tempest-AttachVolumeShelveTestJSON-1476482184-project-member</nova:user>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:project uuid="22dd3139d0af4e319ee02bff3155650b">tempest-AttachVolumeShelveTestJSON-1476482184</nova:project>
Aug 26 22:09:02 user nova-compute[72929]:       </nova:owner>
Aug 26 22:09:02 user nova-compute[72929]:       <nova:root type="image" uuid="143449c1-2485-419f-864c-75bab561a3e9"/>
Aug 26 22:09:02 user nova-compute[72929]:       <nova:ports>
Aug 26 22:09:02 user nova-compute[72929]:         <nova:port uuid="31f5f5c0-90be-4968-af17-b2fa7ea45f29">
Aug 26 22:09:02 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 26 22:09:02 user nova-compute[72929]:         </nova:port>
Aug 26 22:09:02 user nova-compute[72929]:       </nova:ports>
Aug 26 22:09:02 user nova-compute[72929]:     </nova:instance>
Aug 26 22:09:02 user nova-compute[72929]:   </metadata>
Aug 26 22:09:02 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:09:02 user nova-compute[72929]:     <system>
Aug 26 22:09:02 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:09:02 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:09:02 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:09:02 user nova-compute[72929]:       <entry name="serial">387ba104-895e-433c-a100-51b98acf8c15</entry>
Aug 26 22:09:02 user nova-compute[72929]:       <entry name="uuid">387ba104-895e-433c-a100-51b98acf8c15</entry>
Aug 26 22:09:02 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:09:02 user nova-compute[72929]:     </system>
Aug 26 22:09:02 user nova-compute[72929]:   </sysinfo>
Aug 26 22:09:02 user nova-compute[72929]:   <os>
Aug 26 22:09:02 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:09:02 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:09:02 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:09:02 user nova-compute[72929]:   </os>
Aug 26 22:09:02 user nova-compute[72929]:   <features>
Aug 26 22:09:02 user nova-compute[72929]:     <acpi/>
Aug 26 22:09:02 user nova-compute[72929]:     <apic/>
Aug 26 22:09:02 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:09:02 user nova-compute[72929]:   </features>
Aug 26 22:09:02 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:09:02 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:09:02 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:09:02 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:09:02 user nova-compute[72929]:   </clock>
Aug 26 22:09:02 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:09:02 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:09:02 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:09:02 user nova-compute[72929]:   </cpu>
Aug 26 22:09:02 user nova-compute[72929]:   <devices>
Aug 26 22:09:02 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:09:02 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:09:02 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk"/>
Aug 26 22:09:02 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:09:02 user nova-compute[72929]:     </disk>
Aug 26 22:09:02 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:09:02 user nova-compute[72929]:       <mac address="fa:16:3e:e1:be:fe"/>
Aug 26 22:09:02 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:09:02 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:09:02 user nova-compute[72929]:       <target dev="tap31f5f5c0-90"/>
Aug 26 22:09:02 user nova-compute[72929]:     </interface>
Aug 26 22:09:02 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:09:02 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/console.log" append="off"/>
Aug 26 22:09:02 user nova-compute[72929]:     </serial>
Aug 26 22:09:02 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:09:02 user nova-compute[72929]:     <video>
Aug 26 22:09:02 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:09:02 user nova-compute[72929]:     </video>
Aug 26 22:09:02 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:09:02 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:09:02 user nova-compute[72929]:     </rng>
Aug 26 22:09:02 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:09:02 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:09:02 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:09:02 user nova-compute[72929]:     </memballoon>
Aug 26 22:09:02 user nova-compute[72929]:   </devices>
Aug 26 22:09:02 user nova-compute[72929]: </domain>
Aug 26 22:09:02 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-738784921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-738784921',id=23,image_ref='143449c1-2485-419f-864c-75bab561a3e9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1698526643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:05:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-ujoxx46c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member',shelved_at='2023-08-26T22:07:08.734311',shelved_host='user',shelved_image_id='143449c1-2485-419f-864c-75bab561a3e9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=387ba104-895e-433c-a100-51b98acf8c15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG os_vif [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31f5f5c0-90, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31f5f5c0-90, col_values=(('external_ids', {'iface-id': '31f5f5c0-90be-4968-af17-b2fa7ea45f29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:be:fe', 'vm-uuid': '387ba104-895e-433c-a100-51b98acf8c15'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:02 user nova-compute[72929]: INFO os_vif [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90')
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:09:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] No VIF found with MAC fa:16:3e:e1:be:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:09:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087746.7816536, 387ba104-895e-433c-a100-51b98acf8c15 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] VM Resumed (Lifecycle Event)
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:09:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance spawned successfully.
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:09:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087746.7831419, 387ba104-895e-433c-a100-51b98acf8c15 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] VM Started (Lifecycle Event)
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:09:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:09:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-367d91cc-c906-4b6e-b4ae-759561ef4b85 req-96fe1770-0c6c-4ff4-a00a-bc796505d7b9 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-367d91cc-c906-4b6e-b4ae-759561ef4b85 req-96fe1770-0c6c-4ff4-a00a-bc796505d7b9 service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-367d91cc-c906-4b6e-b4ae-759561ef4b85 req-96fe1770-0c6c-4ff4-a00a-bc796505d7b9 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-367d91cc-c906-4b6e-b4ae-759561ef4b85 req-96fe1770-0c6c-4ff4-a00a-bc796505d7b9 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-367d91cc-c906-4b6e-b4ae-759561ef4b85 req-96fe1770-0c6c-4ff4-a00a-bc796505d7b9 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:07 user nova-compute[72929]: WARNING nova.compute.manager [req-367d91cc-c906-4b6e-b4ae-759561ef4b85 req-96fe1770-0c6c-4ff4-a00a-bc796505d7b9 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 22:09:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-85d835b3-77a1-4b72-b3ac-95f496e7dc62 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.533s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:09:08 user nova-compute[72929]: INFO nova.compute.claims [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Claim successful on node user
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:09:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:09:09 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.policy [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58ec50e583e84c07a7be2f882403326e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a729ec8b2e46909a2f4084ccc8a347', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-1385acae-3e52-406b-bd77-fb479260be31 req-a8baf79a-1638-46f7-9c28-15c3f13ff206 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1385acae-3e52-406b-bd77-fb479260be31 req-a8baf79a-1638-46f7-9c28-15c3f13ff206 service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1385acae-3e52-406b-bd77-fb479260be31 req-a8baf79a-1638-46f7-9c28-15c3f13ff206 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1385acae-3e52-406b-bd77-fb479260be31 req-a8baf79a-1638-46f7-9c28-15c3f13ff206 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-1385acae-3e52-406b-bd77-fb479260be31 req-a8baf79a-1638-46f7-9c28-15c3f13ff206 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:09 user nova-compute[72929]: WARNING nova.compute.manager [req-1385acae-3e52-406b-bd77-fb479260be31 req-a8baf79a-1638-46f7-9c28-15c3f13ff206 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state active and task_state None.
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:09:09 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Creating image(s)
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "/opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "/opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk 1073741824" returned: 0 in 0.055s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Successfully created port: 83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Cannot resize image /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Ensure instance console log exists: /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Successfully updated port: 83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "refresh_cache-7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquired lock "refresh_cache-7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG nova.network.neutron [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:10 user nova-compute[72929]: INFO nova.compute.manager [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Terminating instance
Aug 26 22:09:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Updating instance_info_cache with network_info: [{"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Releasing lock "refresh_cache-7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Instance network_info: |[{"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Start _get_guest_xml network_info=[{"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:09:11 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:11 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-334830801',display_name='tempest-VolumesActionsTest-instance-334830801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-334830801',id=29,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a729ec8b2e46909a2f4084ccc8a347',ramdisk_id='',reservation_id='r-kkx0kjwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-170522998',owner_user_name='tempest-VolumesActionsTest-170522998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:09:09Z,user_data=None,user_id='58ec50e583e84c07a7be2f882403326e',uuid=7c968ba9-39e0-4d57-ad3d-b4ed483b03f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Converting VIF {"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-dacf11eb-0a49-4e31-856d-83df278b2aee req-3ff92045-375b-41cc-aae3-874f427e703d service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-unplugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dacf11eb-0a49-4e31-856d-83df278b2aee req-3ff92045-375b-41cc-aae3-874f427e703d service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dacf11eb-0a49-4e31-856d-83df278b2aee req-3ff92045-375b-41cc-aae3-874f427e703d service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dacf11eb-0a49-4e31-856d-83df278b2aee req-3ff92045-375b-41cc-aae3-874f427e703d service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-dacf11eb-0a49-4e31-856d-83df278b2aee req-3ff92045-375b-41cc-aae3-874f427e703d service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-unplugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-dacf11eb-0a49-4e31-856d-83df278b2aee req-3ff92045-375b-41cc-aae3-874f427e703d service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-unplugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:09:11 user nova-compute[72929]:   <uuid>7c968ba9-39e0-4d57-ad3d-b4ed483b03f6</uuid>
Aug 26 22:09:11 user nova-compute[72929]:   <name>instance-0000001d</name>
Aug 26 22:09:11 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:09:11 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:09:11 user nova-compute[72929]:   <metadata>
Aug 26 22:09:11 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:09:11 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:09:11 user nova-compute[72929]:       <nova:name>tempest-VolumesActionsTest-instance-334830801</nova:name>
Aug 26 22:09:11 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:09:11</nova:creationTime>
Aug 26 22:09:11 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:09:11 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:09:11 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:09:11 user nova-compute[72929]:       <nova:owner>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:user uuid="58ec50e583e84c07a7be2f882403326e">tempest-VolumesActionsTest-170522998-project-member</nova:user>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:project uuid="d3a729ec8b2e46909a2f4084ccc8a347">tempest-VolumesActionsTest-170522998</nova:project>
Aug 26 22:09:11 user nova-compute[72929]:       </nova:owner>
Aug 26 22:09:11 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:09:11 user nova-compute[72929]:       <nova:ports>
Aug 26 22:09:11 user nova-compute[72929]:         <nova:port uuid="83803bcc-34a6-4643-9504-d57bedac1035">
Aug 26 22:09:11 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 22:09:11 user nova-compute[72929]:         </nova:port>
Aug 26 22:09:11 user nova-compute[72929]:       </nova:ports>
Aug 26 22:09:11 user nova-compute[72929]:     </nova:instance>
Aug 26 22:09:11 user nova-compute[72929]:   </metadata>
Aug 26 22:09:11 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:09:11 user nova-compute[72929]:     <system>
Aug 26 22:09:11 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:09:11 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:09:11 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:09:11 user nova-compute[72929]:       <entry name="serial">7c968ba9-39e0-4d57-ad3d-b4ed483b03f6</entry>
Aug 26 22:09:11 user nova-compute[72929]:       <entry name="uuid">7c968ba9-39e0-4d57-ad3d-b4ed483b03f6</entry>
Aug 26 22:09:11 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:09:11 user nova-compute[72929]:     </system>
Aug 26 22:09:11 user nova-compute[72929]:   </sysinfo>
Aug 26 22:09:11 user nova-compute[72929]:   <os>
Aug 26 22:09:11 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:09:11 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:09:11 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:09:11 user nova-compute[72929]:   </os>
Aug 26 22:09:11 user nova-compute[72929]:   <features>
Aug 26 22:09:11 user nova-compute[72929]:     <acpi/>
Aug 26 22:09:11 user nova-compute[72929]:     <apic/>
Aug 26 22:09:11 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:09:11 user nova-compute[72929]:   </features>
Aug 26 22:09:11 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:09:11 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:09:11 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:09:11 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:09:11 user nova-compute[72929]:   </clock>
Aug 26 22:09:11 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:09:11 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:09:11 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:09:11 user nova-compute[72929]:   </cpu>
Aug 26 22:09:11 user nova-compute[72929]:   <devices>
Aug 26 22:09:11 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:09:11 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:09:11 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk"/>
Aug 26 22:09:11 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:09:11 user nova-compute[72929]:     </disk>
Aug 26 22:09:11 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:09:11 user nova-compute[72929]:       <mac address="fa:16:3e:c9:4f:1f"/>
Aug 26 22:09:11 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:09:11 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:09:11 user nova-compute[72929]:       <target dev="tap83803bcc-34"/>
Aug 26 22:09:11 user nova-compute[72929]:     </interface>
Aug 26 22:09:11 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:09:11 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/console.log" append="off"/>
Aug 26 22:09:11 user nova-compute[72929]:     </serial>
Aug 26 22:09:11 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:09:11 user nova-compute[72929]:     <video>
Aug 26 22:09:11 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:09:11 user nova-compute[72929]:     </video>
Aug 26 22:09:11 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:09:11 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:09:11 user nova-compute[72929]:     </rng>
Aug 26 22:09:11 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:09:11 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:09:11 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:09:11 user nova-compute[72929]:     </memballoon>
Aug 26 22:09:11 user nova-compute[72929]:   </devices>
Aug 26 22:09:11 user nova-compute[72929]: </domain>
Aug 26 22:09:11 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-334830801',display_name='tempest-VolumesActionsTest-instance-334830801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-334830801',id=29,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3a729ec8b2e46909a2f4084ccc8a347',ramdisk_id='',reservation_id='r-kkx0kjwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-170522998',owner_user_name='tempest-VolumesActionsTest-170522998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:09:09Z,user_data=None,user_id='58ec50e583e84c07a7be2f882403326e',uuid=7c968ba9-39e0-4d57-ad3d-b4ed483b03f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Converting VIF {"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG os_vif [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83803bcc-34, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83803bcc-34, col_values=(('external_ids', {'iface-id': '83803bcc-34a6-4643-9504-d57bedac1035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:4f:1f', 'vm-uuid': '7c968ba9-39e0-4d57-ad3d-b4ed483b03f6'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-changed-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Refreshing instance network info cache due to event network-changed-83803bcc-34a6-4643-9504-d57bedac1035. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] Acquiring lock "refresh_cache-7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] Acquired lock "refresh_cache-7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Refreshing network info cache for port 83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: INFO os_vif [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34')
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] No VIF found with MAC fa:16:3e:c9:4f:1f, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Updated VIF entry in instance network info cache for port 83803bcc-34a6-4643-9504-d57bedac1035. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Updating instance_info_cache with network_info: [{"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0acdbbc-c75e-47e4-a5f0-ebafeec1d344 req-89693ae9-7e05-4ed0-91db-aa50456b05e2 service nova] Releasing lock "refresh_cache-7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:09:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Instance destroyed successfully.
Aug 26 22:09:12 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lazy-loading 'resources' on Instance uuid 3d4b6c0c-916e-4698-9add-32f3e85216cd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:07:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-879435078',display_name='tempest-VolumesActionsTest-instance-879435078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-879435078',id=26,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:07:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8342795a1fd4e0da2e3bd1bb7599281',ramdisk_id='',reservation_id='r-iz1uijai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1243309740',owner_user_name='tempest-VolumesActionsTest-1243309740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:07:28Z,user_data=None,user_id='7e6d3ec106b9413f8879d505213b3466',uuid=3d4b6c0c-916e-4698-9add-32f3e85216cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converting VIF {"id": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "address": "fa:16:3e:04:8a:cc", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd29aa46-15", "ovs_interfaceid": "cd29aa46-156e-4e40-9c14-71b79880fb9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG os_vif [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd29aa46-15, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: INFO os_vif [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:8a:cc,bridge_name='br-int',has_traffic_filtering=True,id=cd29aa46-156e-4e40-9c14-71b79880fb9b,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd29aa46-15')
Aug 26 22:09:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Deleting instance files /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd_del
Aug 26 22:09:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Deletion of /opt/stack/data/nova/instances/3d4b6c0c-916e-4698-9add-32f3e85216cd_del complete
Aug 26 22:09:12 user nova-compute[72929]: INFO nova.compute.manager [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Took 1.89 seconds to destroy the instance on the hypervisor.
Aug 26 22:09:12 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:13 user nova-compute[72929]: WARNING nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received unexpected event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with vm_state active and task_state deleting.
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:13 user nova-compute[72929]: WARNING nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received unexpected event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with vm_state active and task_state deleting.
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:13 user nova-compute[72929]: WARNING nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received unexpected event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with vm_state active and task_state deleting.
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-unplugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-unplugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-unplugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Acquiring lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] No waiting events found dispatching network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:13 user nova-compute[72929]: WARNING nova.compute.manager [req-953ee3a8-1c8e-4478-b857-d7639033c61e req-6029e168-0ddc-4aba-8f6a-b0d65e35a76e service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received unexpected event network-vif-plugged-cd29aa46-156e-4e40-9c14-71b79880fb9b for instance with vm_state active and task_state deleting.
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:09:13 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Took 0.58 seconds to deallocate network for instance.
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-08789a3b-ae03-42af-a531-b3f2eae1bca1 req-e01012ff-ca18-4f44-99cc-a21a344add0d service nova] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Received event network-vif-deleted-cd29aa46-156e-4e40-9c14-71b79880fb9b {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:13 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Deleted allocations for instance 3d4b6c0c-916e-4698-9add-32f3e85216cd
Aug 26 22:09:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0604e6c-e353-4a4b-8c7c-69f7830ae830 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "3d4b6c0c-916e-4698-9add-32f3e85216cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.152s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087755.0533545, 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] VM Resumed (Lifecycle Event)
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Instance spawned successfully.
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087755.0544238, 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] VM Started (Lifecycle Event)
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:15 user nova-compute[72929]: INFO nova.compute.manager [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Took 6.89 seconds to build instance.
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-79ba0ce2-c69f-4d19-8e68-906f47c1b147 tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.983s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] No waiting events found dispatching network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:15 user nova-compute[72929]: WARNING nova.compute.manager [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received unexpected event network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 for instance with vm_state active and task_state None.
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] No waiting events found dispatching network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:15 user nova-compute[72929]: WARNING nova.compute.manager [req-b73a1ce7-8f5d-4d85-895b-dbcfe4f4a99f req-71213f94-89b5-41d4-b02c-7182c54296f6 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received unexpected event network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 for instance with vm_state active and task_state None.
Aug 26 22:09:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Port 7a8d4c8c-2672-4af8-b42e-54be12e2544e binding to destination host user is already ACTIVE {{(pid=72929) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Creating tmpfile /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/tmp_wkssj41 to verify with other compute node that the instance is on the same shared storage. {{(pid=72929) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-e2254002-7511-4a65-aef0-583a5dcae7b1 req-fcc631dc-7d70-4ec3-8180-9cebb16767d6 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e2254002-7511-4a65-aef0-583a5dcae7b1 req-fcc631dc-7d70-4ec3-8180-9cebb16767d6 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e2254002-7511-4a65-aef0-583a5dcae7b1 req-fcc631dc-7d70-4ec3-8180-9cebb16767d6 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e2254002-7511-4a65-aef0-583a5dcae7b1 req-fcc631dc-7d70-4ec3-8180-9cebb16767d6 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-e2254002-7511-4a65-aef0-583a5dcae7b1 req-fcc631dc-7d70-4ec3-8180-9cebb16767d6 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:25 user nova-compute[72929]: WARNING nova.compute.manager [req-e2254002-7511-4a65-aef0-583a5dcae7b1 req-fcc631dc-7d70-4ec3-8180-9cebb16767d6 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state resized and task_state resize_reverting.
Aug 26 22:09:25 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:25 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7017MB free_disk=24.161376953125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:25 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance destroyed successfully.
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.objects.instance [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'resources' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Applying migration context for instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 as it has an incoming, in-progress migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39. Migration status is reverting {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 22:09:25 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating resource usage from migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:07:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:07:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a8d4c8c-26, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:25 user nova-compute[72929]: INFO os_vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26')
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 387ba104-895e-433c-a100-51b98acf8c15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=33GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:09:25 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77cf376-4199-4146-aec2-90100e0582a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[727f160a-e728-4dc8-8f0c-fd68e08d4365]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:09:25 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:09:25 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:09:25 user nova-compute[72929]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:09:25 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803ce170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06de5d2-908a-4ead-93de-aa1de84650fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[907cd097-12ab-4cbd-85a0-eaf4d258ad76]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9fea9a-9ce8-40f3-960c-02454288ff54]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd216b-751d-4e3a-bbd7-c0bafc52cbd3]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b5fd3-6ea8-440f-a19b-532f15140fd4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa0511b-0d9a-47ed-abd0-7d4d3b97f24b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]
Aug 26 22:09:26 user nova-compute[72929]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.
Aug 26 22:09:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9f0fd-e7cc-495f-a218-261f6f2dcebc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== disconnect_volume: return (281ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG nova.objects.instance [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'migration_context' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:26 user nova-compute[72929]: DEBUG nova.objects.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Object Instance<17b027b1-b249-4fc9-a8f5-43e0cf919525> lazy-loaded attributes: resources,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-e3ca1e09-546c-4782-966d-21bc87e14263 req-70ea8ff5-bf76-4057-b223-85e768b01a65 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e3ca1e09-546c-4782-966d-21bc87e14263 req-70ea8ff5-bf76-4057-b223-85e768b01a65 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e3ca1e09-546c-4782-966d-21bc87e14263 req-70ea8ff5-bf76-4057-b223-85e768b01a65 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e3ca1e09-546c-4782-966d-21bc87e14263 req-70ea8ff5-bf76-4057-b223-85e768b01a65 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-e3ca1e09-546c-4782-966d-21bc87e14263 req-70ea8ff5-bf76-4057-b223-85e768b01a65 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:27 user nova-compute[72929]: WARNING nova.compute.manager [req-e3ca1e09-546c-4782-966d-21bc87e14263 req-70ea8ff5-bf76-4057-b223-85e768b01a65 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state resized and task_state resize_reverting.
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.545s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087752.5609775, 3d4b6c0c-916e-4698-9add-32f3e85216cd => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:27 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] VM Stopped (Lifecycle Event)
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-76e844f8-7dce-4abc-8764-78d78f6a557e None None] [instance: 3d4b6c0c-916e-4698-9add-32f3e85216cd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:27 user nova-compute[72929]: INFO nova.compute.manager [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Swapping old allocation on dict_keys(['2fc6464f-291c-4428-855f-57fcef178e83']) held by migration 80a6f3ef-171e-47c1-beff-b2b454fa0e39 for instance
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Overwriting current allocation {'allocations': {'2fc6464f-291c-4428-855f-57fcef178e83': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 35}}, 'project_id': '2e7f712c6e7e418caa20ca971c810660', 'user_id': '9c6aeec78644486ba130cf6084d76887', 'consumer_generation': 1} on consumer 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:09:27 user nova-compute[72929]: DEBUG nova.network.neutron [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG os_brick.utils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bec5300-22ad-4752-b74c-caf00aea51a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8416fc91-2eff-4b57-8aff-30eaff2e6b0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[13710980-df50-40d3-b66e-c3d38c99ccc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9d66b9-d35d-43d6-a76b-49999be2d209]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:09:28 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13a91e2-9c98-4b61-b00a-c0e0d0bda0ed]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG os_brick.utils [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:09:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:09:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:36 user nova-compute[72929]: INFO nova.compute.manager [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Detaching volume 58f3a0bd-366b-4049-99eb-91a01af282ff
Aug 26 22:09:36 user nova-compute[72929]: INFO nova.virt.block_device [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Attempting to driver detach volume 58f3a0bd-366b-4049-99eb-91a01af282ff from mountpoint /dev/vdb
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Attempting to detach device vdb from instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:09:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:09:36 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:09:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:09:36 user nova-compute[72929]:   <serial>58f3a0bd-366b-4049-99eb-91a01af282ff</serial>
Aug 26 22:09:36 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:09:36 user nova-compute[72929]: </disk>
Aug 26 22:09:36 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:09:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully detached device vdb from instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc from the persistent domain config.
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:09:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:09:36 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:09:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:09:36 user nova-compute[72929]:   <serial>58f3a0bd-366b-4049-99eb-91a01af282ff</serial>
Aug 26 22:09:36 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:09:36 user nova-compute[72929]: </disk>
Aug 26 22:09:36 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087776.6990077, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:09:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully detached device vdb from instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc from the live domain config.
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GdEcZXSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:09:36 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5317ee05-7cb1-4e45-ab93-6188da02e87a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f472d4-048b-492f-bf64-7f37e3b97549]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:09:36 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff (non-flash)
Aug 26 22:09:36 user nova-compute[72929]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba68e1750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f3e1a7-a350-4244-9b15-12aeec0516a7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37be993a-301f-42d9-8213-ce2b41da49a9]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[911723c6-a416-469c-9d69-d266610d8aa4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bedf8ed-9428-4c8c-8eb1-c551ff3b316c]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9c645-2921-456f-88f6-c0002271aeab]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0cf0cf-3270-44e0-aabe-031b4606beea]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260]
Aug 26 22:09:36 user nova-compute[72929]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff, portal: 172.16.0.220,3260] successful.
Aug 26 22:09:36 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58f3a0bd-366b-4049-99eb-91a01af282ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[10250182-0edb-4393-9f6c-2fc01e78ae56]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== disconnect_volume: return (260ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:09:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:09:37 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'flavor' on Instance uuid ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c3bc19be-e3b1-4c79-af8a-cc8a44e5a8ca tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Starting finish_revert_migration {{(pid=72929) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start _get_guest_xml network_info=[{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '9e9a8453-b05b-4fed-a5e4-763af781fc89', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '17b027b1-b249-4fc9-a8f5-43e0cf919525', 'attached_at': '2023-08-26T22:09:40.000000', 'detached_at': '', 'volume_id': '92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94', 'serial': '92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:09:39 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:39 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.objects.instance [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:09:39 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:09:39 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:09:39 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fd1956-7a72-4c81-88cf-bafab4f40a28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:09:39 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[94231a39-f875-42a2-9801-4a42a130b188]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94] added
Aug 26 22:09:39 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed8527-b0a5-4715-84df-ea8a01758f59]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[088789d0-800a-45b6-92e7-08d98cd6acd8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnYesQmi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xnYesQmi" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[097d727c-2882-4b29-9046-ee37da626551]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xnYesQmi'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9de5e-8676-44aa-b966-f5f85d01c142]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b260d6-5667-4375-8437-68e00a30d9e0]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:39 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:39 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:09:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaec83e-017d-47e7-9add-990798f3bb02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]
Aug 26 22:09:40 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.
Aug 26 22:09:40 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d154c32d-e3b4-49b6-a20e-d6dcd3c84851]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0db8e0b-8af6-4b14-8471-2fec83b2b8a2]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:40 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:09:40 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:09:40 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:09:40 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac21d720-5cd4-4945-90aa-c3ed71cec5ae]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087765.6727202, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:40 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Stopped (Lifecycle Event)
Aug 26 22:09:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0ec9ccee-91c5-42e0-b235-6da560eb20be None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26632333264363137', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632333264363137', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:07:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:09:41 user nova-compute[72929]:   <uuid>17b027b1-b249-4fc9-a8f5-43e0cf919525</uuid>
Aug 26 22:09:41 user nova-compute[72929]:   <name>instance-00000013</name>
Aug 26 22:09:41 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:09:41 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:09:41 user nova-compute[72929]:   <metadata>
Aug 26 22:09:41 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:09:41 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:09:41 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherB-server-1992218640</nova:name>
Aug 26 22:09:41 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:09:39</nova:creationTime>
Aug 26 22:09:41 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:09:41 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:09:41 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:09:41 user nova-compute[72929]:       <nova:owner>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:user uuid="9c6aeec78644486ba130cf6084d76887">tempest-ServerActionsTestOtherB-381550606-project-member</nova:user>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:project uuid="2e7f712c6e7e418caa20ca971c810660">tempest-ServerActionsTestOtherB-381550606</nova:project>
Aug 26 22:09:41 user nova-compute[72929]:       </nova:owner>
Aug 26 22:09:41 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:09:41 user nova-compute[72929]:       <nova:ports>
Aug 26 22:09:41 user nova-compute[72929]:         <nova:port uuid="7a8d4c8c-2672-4af8-b42e-54be12e2544e">
Aug 26 22:09:41 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:09:41 user nova-compute[72929]:         </nova:port>
Aug 26 22:09:41 user nova-compute[72929]:       </nova:ports>
Aug 26 22:09:41 user nova-compute[72929]:     </nova:instance>
Aug 26 22:09:41 user nova-compute[72929]:   </metadata>
Aug 26 22:09:41 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:09:41 user nova-compute[72929]:     <system>
Aug 26 22:09:41 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:09:41 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:09:41 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:09:41 user nova-compute[72929]:       <entry name="serial">17b027b1-b249-4fc9-a8f5-43e0cf919525</entry>
Aug 26 22:09:41 user nova-compute[72929]:       <entry name="uuid">17b027b1-b249-4fc9-a8f5-43e0cf919525</entry>
Aug 26 22:09:41 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:09:41 user nova-compute[72929]:     </system>
Aug 26 22:09:41 user nova-compute[72929]:   </sysinfo>
Aug 26 22:09:41 user nova-compute[72929]:   <os>
Aug 26 22:09:41 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:09:41 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:09:41 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:09:41 user nova-compute[72929]:   </os>
Aug 26 22:09:41 user nova-compute[72929]:   <features>
Aug 26 22:09:41 user nova-compute[72929]:     <acpi/>
Aug 26 22:09:41 user nova-compute[72929]:     <apic/>
Aug 26 22:09:41 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:09:41 user nova-compute[72929]:   </features>
Aug 26 22:09:41 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:09:41 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:09:41 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:09:41 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:09:41 user nova-compute[72929]:   </clock>
Aug 26 22:09:41 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:09:41 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:09:41 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:09:41 user nova-compute[72929]:   </cpu>
Aug 26 22:09:41 user nova-compute[72929]:   <devices>
Aug 26 22:09:41 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:09:41 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:09:41 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk"/>
Aug 26 22:09:41 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:09:41 user nova-compute[72929]:     </disk>
Aug 26 22:09:41 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:09:41 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:09:41 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:09:41 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:09:41 user nova-compute[72929]:       <serial>92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94</serial>
Aug 26 22:09:41 user nova-compute[72929]:     </disk>
Aug 26 22:09:41 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:09:41 user nova-compute[72929]:       <mac address="fa:16:3e:4b:0f:09"/>
Aug 26 22:09:41 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:09:41 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:09:41 user nova-compute[72929]:       <target dev="tap7a8d4c8c-26"/>
Aug 26 22:09:41 user nova-compute[72929]:     </interface>
Aug 26 22:09:41 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:09:41 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/console.log" append="off"/>
Aug 26 22:09:41 user nova-compute[72929]:     </serial>
Aug 26 22:09:41 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:09:41 user nova-compute[72929]:     <video>
Aug 26 22:09:41 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:09:41 user nova-compute[72929]:     </video>
Aug 26 22:09:41 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:09:41 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:09:41 user nova-compute[72929]:     </rng>
Aug 26 22:09:41 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:09:41 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:09:41 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:09:41 user nova-compute[72929]:     </memballoon>
Aug 26 22:09:41 user nova-compute[72929]:   </devices>
Aug 26 22:09:41 user nova-compute[72929]: </domain>
Aug 26 22:09:41 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:07:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG os_vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a8d4c8c-26, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a8d4c8c-26, col_values=(('external_ids', {'iface-id': '7a8d4c8c-2672-4af8-b42e-54be12e2544e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:0f:09', 'vm-uuid': '17b027b1-b249-4fc9-a8f5-43e0cf919525'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:09:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:41 user nova-compute[72929]: INFO os_vif [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26')
Aug 26 22:09:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-e20d960f-cc1d-466c-9c63-8a828fd98dc0 req-dc403b13-5279-4a75-95e7-4c2e3c94e393 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e20d960f-cc1d-466c-9c63-8a828fd98dc0 req-dc403b13-5279-4a75-95e7-4c2e3c94e393 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e20d960f-cc1d-466c-9c63-8a828fd98dc0 req-dc403b13-5279-4a75-95e7-4c2e3c94e393 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e20d960f-cc1d-466c-9c63-8a828fd98dc0 req-dc403b13-5279-4a75-95e7-4c2e3c94e393 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-e20d960f-cc1d-466c-9c63-8a828fd98dc0 req-dc403b13-5279-4a75-95e7-4c2e3c94e393 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:42 user nova-compute[72929]: WARNING nova.compute.manager [req-e20d960f-cc1d-466c-9c63-8a828fd98dc0 req-dc403b13-5279-4a75-95e7-4c2e3c94e393 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state resized and task_state resize_reverting.
Aug 26 22:09:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087784.6733425, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Resumed (Lifecycle Event)
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:09:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance running successfully.
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] finish_revert_migration finished successfully. {{(pid=72929) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:09:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087784.6742113, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:09:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Started (Lifecycle Event)
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:09:44 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-cec8b018-b6fd-41cd-b79e-2fd2dd363bbc req-aa8eaa84-355a-40ac-b455-73e6c7cabf23 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cec8b018-b6fd-41cd-b79e-2fd2dd363bbc req-aa8eaa84-355a-40ac-b455-73e6c7cabf23 service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cec8b018-b6fd-41cd-b79e-2fd2dd363bbc req-aa8eaa84-355a-40ac-b455-73e6c7cabf23 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cec8b018-b6fd-41cd-b79e-2fd2dd363bbc req-aa8eaa84-355a-40ac-b455-73e6c7cabf23 service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:09:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-cec8b018-b6fd-41cd-b79e-2fd2dd363bbc req-aa8eaa84-355a-40ac-b455-73e6c7cabf23 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:09:44 user nova-compute[72929]: WARNING nova.compute.manager [req-cec8b018-b6fd-41cd-b79e-2fd2dd363bbc req-aa8eaa84-355a-40ac-b455-73e6c7cabf23 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state resized and task_state resize_reverting.
Aug 26 22:09:45 user nova-compute[72929]: INFO nova.compute.manager [None req-945f417c-9ede-4317-ab5d-eb60b62b370e tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance to original state: 'active'
Aug 26 22:09:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:09:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:09:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:09:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:09:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:09:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:00 user nova-compute[72929]: INFO nova.compute.manager [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Unrescuing
Aug 26 22:10:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG nova.objects.instance [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'flavor' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-e7491c53-8485-4a8f-8ce7-424b44ee06c2 req-365469fe-cb9c-4fb1-b12b-f6d4c719ee17 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e7491c53-8485-4a8f-8ce7-424b44ee06c2 req-365469fe-cb9c-4fb1-b12b-f6d4c719ee17 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e7491c53-8485-4a8f-8ce7-424b44ee06c2 req-365469fe-cb9c-4fb1-b12b-f6d4c719ee17 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e7491c53-8485-4a8f-8ce7-424b44ee06c2 req-365469fe-cb9c-4fb1-b12b-f6d4c719ee17 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-e7491c53-8485-4a8f-8ce7-424b44ee06c2 req-365469fe-cb9c-4fb1-b12b-f6d4c719ee17 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:01 user nova-compute[72929]: WARNING nova.compute.manager [req-e7491c53-8485-4a8f-8ce7-424b44ee06c2 req-365469fe-cb9c-4fb1-b12b-f6d4c719ee17 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-changed-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Refreshing instance network info cache due to event network-changed-69f58484-9f9b-4835-b269-644441508b83. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] Acquiring lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] Acquired lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG nova.network.neutron [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Refreshing network info cache for port 69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance destroyed successfully.
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:10:03 user nova-compute[72929]: INFO nova.compute.claims [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Claim successful on node user
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updated VIF entry in instance network info cache for port 69f58484-9f9b-4835-b269-644441508b83. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updating instance_info_cache with network_info: [{"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fd72bfe9-5c7f-493c-93b5-2a6403902688 req-5071f422-2892-4f16-9924-68edf8042298 service nova] Releasing lock "refresh_cache-9cfedc10-54d5-4ce0-8d15-9f0d23361489" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing instance network info cache due to event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:03 user nova-compute[72929]: WARNING nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:03 user nova-compute[72929]: WARNING nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:03 user nova-compute[72929]: WARNING nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:03 user nova-compute[72929]: WARNING nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:03 user nova-compute[72929]: WARNING nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:03 user nova-compute[72929]: WARNING nova.compute.manager [req-bf373560-93aa-41fe-af5f-53d9c05412de req-70df77e2-1664-4577-b5b5-06c39f999d9e service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:03 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updated VIF entry in instance network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.network.neutron [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b0d6e3a5-c574-4973-87f0-fd3d1691607d req-8371d6c9-7c17-47ef-b788-eccbc3f6076d service nova] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:10:04 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.policy [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e6d3ec106b9413f8879d505213b3466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8342795a1fd4e0da2e3bd1bb7599281', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:10:04 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Creating image(s)
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "/opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "/opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "/opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.235s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.247s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk 1073741824" returned: 0 in 0.095s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Successfully created port: 7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.222s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Cannot resize image /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Ensure instance console log exists: /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:05 user nova-compute[72929]: INFO nova.compute.manager [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] instance snapshotting
Aug 26 22:10:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Beginning live snapshot process
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-c1988d39-1afa-4abe-99b4-101f5cf46fc1 req-e36527c1-12c0-4293-8058-af9a35a38b90 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1988d39-1afa-4abe-99b4-101f5cf46fc1 req-e36527c1-12c0-4293-8058-af9a35a38b90 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1988d39-1afa-4abe-99b4-101f5cf46fc1 req-e36527c1-12c0-4293-8058-af9a35a38b90 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1988d39-1afa-4abe-99b4-101f5cf46fc1 req-e36527c1-12c0-4293-8058-af9a35a38b90 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-c1988d39-1afa-4abe-99b4-101f5cf46fc1 req-e36527c1-12c0-4293-8058-af9a35a38b90 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:05 user nova-compute[72929]: WARNING nova.compute.manager [req-c1988d39-1afa-4abe-99b4-101f5cf46fc1 req-e36527c1-12c0-4293-8058-af9a35a38b90 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json -f qcow2" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Successfully updated port: 7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ab381439-8843-4bc2-a85f-6f5dc5cd83a9 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for f16261bd-823d-4d47-9f2e-f33c0c03cfdf due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087806.0651186, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Resumed (Lifecycle Event)
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "refresh_cache-9749ba34-28ea-4e7f-8f3e-a99e61e1acee" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquired lock "refresh_cache-9749ba34-28ea-4e7f-8f3e-a99e61e1acee" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-changed-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Refreshing instance network info cache due to event network-changed-7328f1c9-7557-48a9-ae12-e5c10bc03516. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] Acquiring lock "refresh_cache-9749ba34-28ea-4e7f-8f3e-a99e61e1acee" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087806.0720274, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:06 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Started (Lifecycle Event)
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps476gq7c/e9f0ba2f10f34c2f85b0f570d92bcfca.delta 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps476gq7c/e9f0ba2f10f34c2f85b0f570d92bcfca.delta 1073741824" returned: 0 in 0.054s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Updating instance_info_cache with network_info: [{"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Releasing lock "refresh_cache-9749ba34-28ea-4e7f-8f3e-a99e61e1acee" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Instance network_info: |[{"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] Acquired lock "refresh_cache-9749ba34-28ea-4e7f-8f3e-a99e61e1acee" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Refreshing network info cache for port 7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Start _get_guest_xml network_info=[{"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:10:06 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:10:06 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-143785799',display_name='tempest-VolumesActionsTest-instance-143785799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-143785799',id=30,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8342795a1fd4e0da2e3bd1bb7599281',ramdisk_id='',reservation_id='r-8fdect0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1243309740',owner_user_name='tempest-VolumesActionsTest-1243309740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:10:04Z,user_data=None,user_id='7e6d3ec106b9413f8879d505213b3466',uuid=9749ba34-28ea-4e7f-8f3e-a99e61e1acee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converting VIF {"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lazy-loading 'pci_devices' on Instance uuid 9749ba34-28ea-4e7f-8f3e-a99e61e1acee {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:10:06 user nova-compute[72929]:   <uuid>9749ba34-28ea-4e7f-8f3e-a99e61e1acee</uuid>
Aug 26 22:10:06 user nova-compute[72929]:   <name>instance-0000001e</name>
Aug 26 22:10:06 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:10:06 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:10:06 user nova-compute[72929]:   <metadata>
Aug 26 22:10:06 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:10:06 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:10:06 user nova-compute[72929]:       <nova:name>tempest-VolumesActionsTest-instance-143785799</nova:name>
Aug 26 22:10:06 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:10:06</nova:creationTime>
Aug 26 22:10:06 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:10:06 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:10:06 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:10:06 user nova-compute[72929]:       <nova:owner>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:user uuid="7e6d3ec106b9413f8879d505213b3466">tempest-VolumesActionsTest-1243309740-project-member</nova:user>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:project uuid="c8342795a1fd4e0da2e3bd1bb7599281">tempest-VolumesActionsTest-1243309740</nova:project>
Aug 26 22:10:06 user nova-compute[72929]:       </nova:owner>
Aug 26 22:10:06 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:10:06 user nova-compute[72929]:       <nova:ports>
Aug 26 22:10:06 user nova-compute[72929]:         <nova:port uuid="7328f1c9-7557-48a9-ae12-e5c10bc03516">
Aug 26 22:10:06 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 26 22:10:06 user nova-compute[72929]:         </nova:port>
Aug 26 22:10:06 user nova-compute[72929]:       </nova:ports>
Aug 26 22:10:06 user nova-compute[72929]:     </nova:instance>
Aug 26 22:10:06 user nova-compute[72929]:   </metadata>
Aug 26 22:10:06 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:10:06 user nova-compute[72929]:     <system>
Aug 26 22:10:06 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:10:06 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:10:06 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:10:06 user nova-compute[72929]:       <entry name="serial">9749ba34-28ea-4e7f-8f3e-a99e61e1acee</entry>
Aug 26 22:10:06 user nova-compute[72929]:       <entry name="uuid">9749ba34-28ea-4e7f-8f3e-a99e61e1acee</entry>
Aug 26 22:10:06 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:10:06 user nova-compute[72929]:     </system>
Aug 26 22:10:06 user nova-compute[72929]:   </sysinfo>
Aug 26 22:10:06 user nova-compute[72929]:   <os>
Aug 26 22:10:06 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:10:06 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:10:06 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:10:06 user nova-compute[72929]:   </os>
Aug 26 22:10:06 user nova-compute[72929]:   <features>
Aug 26 22:10:06 user nova-compute[72929]:     <acpi/>
Aug 26 22:10:06 user nova-compute[72929]:     <apic/>
Aug 26 22:10:06 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:10:06 user nova-compute[72929]:   </features>
Aug 26 22:10:06 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:10:06 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:10:06 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:10:06 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:10:06 user nova-compute[72929]:   </clock>
Aug 26 22:10:06 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:10:06 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:10:06 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:10:06 user nova-compute[72929]:   </cpu>
Aug 26 22:10:06 user nova-compute[72929]:   <devices>
Aug 26 22:10:06 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:10:06 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:10:06 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk"/>
Aug 26 22:10:06 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:10:06 user nova-compute[72929]:     </disk>
Aug 26 22:10:06 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:10:06 user nova-compute[72929]:       <mac address="fa:16:3e:83:de:cf"/>
Aug 26 22:10:06 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:10:06 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:10:06 user nova-compute[72929]:       <target dev="tap7328f1c9-75"/>
Aug 26 22:10:06 user nova-compute[72929]:     </interface>
Aug 26 22:10:06 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:10:06 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/console.log" append="off"/>
Aug 26 22:10:06 user nova-compute[72929]:     </serial>
Aug 26 22:10:06 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:10:06 user nova-compute[72929]:     <video>
Aug 26 22:10:06 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:10:06 user nova-compute[72929]:     </video>
Aug 26 22:10:06 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:10:06 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:10:06 user nova-compute[72929]:     </rng>
Aug 26 22:10:06 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:10:06 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:10:06 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:10:06 user nova-compute[72929]:     </memballoon>
Aug 26 22:10:06 user nova-compute[72929]:   </devices>
Aug 26 22:10:06 user nova-compute[72929]: </domain>
Aug 26 22:10:06 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-143785799',display_name='tempest-VolumesActionsTest-instance-143785799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-143785799',id=30,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c8342795a1fd4e0da2e3bd1bb7599281',ramdisk_id='',reservation_id='r-8fdect0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1243309740',owner_user_name='tempest-VolumesActionsTest-1243309740-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:10:04Z,user_data=None,user_id='7e6d3ec106b9413f8879d505213b3466',uuid=9749ba34-28ea-4e7f-8f3e-a99e61e1acee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converting VIF {"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG os_vif [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7328f1c9-75, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7328f1c9-75, col_values=(('external_ids', {'iface-id': '7328f1c9-7557-48a9-ae12-e5c10bc03516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:de:cf', 'vm-uuid': '9749ba34-28ea-4e7f-8f3e-a99e61e1acee'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:06 user nova-compute[72929]: INFO os_vif [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75')
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] No VIF found with MAC fa:16:3e:83:de:cf, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.objects.instance [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid 9cfedc10-54d5-4ce0-8d15-9f0d23361489 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Updated VIF entry in instance network info cache for port 7328f1c9-7557-48a9-ae12-e5c10bc03516. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Updating instance_info_cache with network_info: [{"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-48d4928c-efb0-47ae-9999-400ebf2b0f23 req-837a380c-5481-4cc7-b08e-5305d0442f92 service nova] Releasing lock "refresh_cache-9749ba34-28ea-4e7f-8f3e-a99e61e1acee" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:07 user nova-compute[72929]: INFO nova.compute.manager [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Attaching volume 2d9acd30-f581-4060-967c-93fe65295d71 to /dev/vdb
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] COPY block job progress, current cursor: 983040 final cursor: 75497472 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG os_brick.utils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbb4e10-9be2-42e5-a263-db3443675e22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[161baa8f-f5a8-4c47-9b89-6692816d51ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd5f25-33ec-4777-951d-edc141ab7aaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df02e6f-31e3-4539-8fbc-c4185eeff7de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:10:07 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a693b45f-0cd7-4982-af81-df926c00205a]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG os_brick.utils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updating existing volume attachment record: 7c1aa355-bc8c-42d8-a438-a60c417b10ea {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:10:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 22:10:07 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:10:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps476gq7c/e9f0ba2f10f34c2f85b0f570d92bcfca.delta /opt/stack/data/nova/instances/snapshots/tmps476gq7c/e9f0ba2f10f34c2f85b0f570d92bcfca {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps476gq7c/e9f0ba2f10f34c2f85b0f570d92bcfca.delta /opt/stack/data/nova/instances/snapshots/tmps476gq7c/e9f0ba2f10f34c2f85b0f570d92bcfca" returned: 0 in 0.586s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Snapshot extracted, beginning image upload
Aug 26 22:10:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-82b50ca0-5d68-4b65-93b9-8ac3dbeb3f07 req-bd793d4d-d3a0-4fd9-a810-9ff2da7f6890 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-82b50ca0-5d68-4b65-93b9-8ac3dbeb3f07 req-bd793d4d-d3a0-4fd9-a810-9ff2da7f6890 service nova] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-82b50ca0-5d68-4b65-93b9-8ac3dbeb3f07 req-bd793d4d-d3a0-4fd9-a810-9ff2da7f6890 service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-82b50ca0-5d68-4b65-93b9-8ac3dbeb3f07 req-bd793d4d-d3a0-4fd9-a810-9ff2da7f6890 service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-82b50ca0-5d68-4b65-93b9-8ac3dbeb3f07 req-bd793d4d-d3a0-4fd9-a810-9ff2da7f6890 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] No waiting events found dispatching network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:08 user nova-compute[72929]: WARNING nova.compute.manager [req-82b50ca0-5d68-4b65-93b9-8ac3dbeb3f07 req-bd793d4d-d3a0-4fd9-a810-9ff2da7f6890 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received unexpected event network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 for instance with vm_state building and task_state spawning.
Aug 26 22:10:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-34bb96bd-2daf-4119-ac6d-afc50ac868d2 req-19a1bd8b-4c1f-4c59-9eac-42a14ae38e62 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-34bb96bd-2daf-4119-ac6d-afc50ac868d2 req-19a1bd8b-4c1f-4c59-9eac-42a14ae38e62 service nova] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-34bb96bd-2daf-4119-ac6d-afc50ac868d2 req-19a1bd8b-4c1f-4c59-9eac-42a14ae38e62 service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-34bb96bd-2daf-4119-ac6d-afc50ac868d2 req-19a1bd8b-4c1f-4c59-9eac-42a14ae38e62 service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-34bb96bd-2daf-4119-ac6d-afc50ac868d2 req-19a1bd8b-4c1f-4c59-9eac-42a14ae38e62 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] No waiting events found dispatching network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:11 user nova-compute[72929]: WARNING nova.compute.manager [req-34bb96bd-2daf-4119-ac6d-afc50ac868d2 req-19a1bd8b-4c1f-4c59-9eac-42a14ae38e62 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received unexpected event network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 for instance with vm_state building and task_state spawning.
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087811.200783, 9749ba34-28ea-4e7f-8f3e-a99e61e1acee => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] VM Resumed (Lifecycle Event)
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Instance spawned successfully.
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087811.2024693, 9749ba34-28ea-4e7f-8f3e-a99e61e1acee => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] VM Started (Lifecycle Event)
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 26 22:10:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Snapshot image upload complete
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-978941c1-c107-47d7-9a15-98b323206720 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Took 5.86 seconds to snapshot the instance on the hypervisor.
Aug 26 22:10:11 user nova-compute[72929]: INFO nova.compute.manager [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Took 8.17 seconds to build instance.
Aug 26 22:10:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d6a0d095-d847-48de-ad8b-6409e7c76ac0 tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.273s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUZrbzus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:10:19 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:10:19 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:10:19 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3274ba-7390-42b0-9dcf-da5ece690bd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:10:19 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00020b59-896b-41d2-9430-514cf49e7b78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71] added
Aug 26 22:10:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[705f3ee9-508f-4991-8190-96945bbecb12]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.125s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bd687b-22e5-46be-b058-a476d936f46a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUZrbzus {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FUZrbzus" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f9e099-90b8-4c4c-90bf-de32ebafa233]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FUZrbzus'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb905027-8fe2-4a4d-9422-873159de899c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a2aaa-e1ee-4644-bc93-2718d6f3ed04]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ff9a0-6012-4e8f-a595-938db5ee26ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260]
Aug 26 22:10:19 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260] successful.
Aug 26 22:10:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[444db780-cac6-4db3-a73f-f9ab4e2e9d66]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fc3fb9-6efd-4f5b-96db-4367163b2e87]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 (non-flash)
Aug 26 22:10:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] HCTL ('34', '-', '-', 0) found on session 34 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[49095b71-a9ae-48e5-9e40-fb4360fa74c1]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Searching for a device in session 34 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:10:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUZrbzus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23461393266353337', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461393266353337', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG nova.objects.instance [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid 9cfedc10-54d5-4ce0-8d15-9f0d23361489 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:10:20 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:10:20 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:10:20 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:10:20 user nova-compute[72929]:   <serial>2d9acd30-f581-4060-967c-93fe65295d71</serial>
Aug 26 22:10:20 user nova-compute[72929]: </disk>
Aug 26 22:10:20 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:10:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] No VIF found with MAC fa:16:3e:4a:39:b4, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-221715c4-f365-45d3-a57a-5610dad6284d tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.871s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:21 user nova-compute[72929]: INFO nova.compute.manager [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Detaching volume 2d9acd30-f581-4060-967c-93fe65295d71
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:21 user nova-compute[72929]: INFO nova.virt.block_device [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Attempting to driver detach volume 2d9acd30-f581-4060-967c-93fe65295d71 from mountpoint /dev/vdb
Aug 26 22:10:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Attempting to detach device vdb from instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:10:21 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:10:21 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:10:21 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:10:21 user nova-compute[72929]:   <serial>2d9acd30-f581-4060-967c-93fe65295d71</serial>
Aug 26 22:10:21 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:10:21 user nova-compute[72929]: </disk>
Aug 26 22:10:21 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:10:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully detached device vdb from instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 from the persistent domain config.
Aug 26 22:10:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:10:21 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:10:21 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:10:21 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:10:21 user nova-compute[72929]:   <serial>2d9acd30-f581-4060-967c-93fe65295d71</serial>
Aug 26 22:10:21 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:10:21 user nova-compute[72929]: </disk>
Aug 26 22:10:21 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:10:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087822.1148446, 9cfedc10-54d5-4ce0-8d15-9f0d23361489 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:10:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully detached device vdb from instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 from the live domain config.
Aug 26 22:10:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FUZrbzus', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:10:22 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c2796-f62a-4613-a4ae-8546c440e204]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d358d-4924-491f-bcfa-690840a4f620]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:10:22 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:10:22 user nova-compute[72929]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 (non-flash)
Aug 26 22:10:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:10:22 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:10:22 user nova-compute[72929]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 (non-flash)
Aug 26 22:10:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803cd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b880b0e-c7fe-431f-a884-7e9c660ca368]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8274773-4994-4bf0-9d91-22fc41a82227]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b5b78-c169-4802-82d9-0d4258948b5f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b713abd-cf97-4010-b4c3-1ad0b6ccb652]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[080233d0-98bf-40f2-9c84-f4d8f375f1e2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2169aa53-3c7b-4be4-8e31-e029eec3f674]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260]
Aug 26 22:10:22 user nova-compute[72929]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71, portal: 172.16.0.220,3260] successful.
Aug 26 22:10:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d9acd30-f581-4060-967c-93fe65295d71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3a7d95-1b60-4e72-852c-f1eac5eb8ec2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] <== disconnect_volume: return (339ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'flavor' on Instance uuid 9cfedc10-54d5-4ce0-8d15-9f0d23361489 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dac13941-7502-4432-b40b-62578d3a0840 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:10:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:26 user nova-compute[72929]: INFO nova.compute.manager [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Terminating instance
Aug 26 22:10:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-8f7da83a-ad0f-4e1f-ad48-2b92906ef18b req-1453f615-af3f-4bb7-931e-525db181a605 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-unplugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8f7da83a-ad0f-4e1f-ad48-2b92906ef18b req-1453f615-af3f-4bb7-931e-525db181a605 service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8f7da83a-ad0f-4e1f-ad48-2b92906ef18b req-1453f615-af3f-4bb7-931e-525db181a605 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8f7da83a-ad0f-4e1f-ad48-2b92906ef18b req-1453f615-af3f-4bb7-931e-525db181a605 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-8f7da83a-ad0f-4e1f-ad48-2b92906ef18b req-1453f615-af3f-4bb7-931e-525db181a605 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-unplugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-8f7da83a-ad0f-4e1f-ad48-2b92906ef18b req-1453f615-af3f-4bb7-931e-525db181a605 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-unplugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:27 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Instance destroyed successfully.
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.objects.instance [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'resources' on Instance uuid ca93842d-f13f-4b73-8e2e-06da55cdc8bc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:27 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:10:27 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=6897MB free_disk=24.10826873779297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:04:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-979185243',display_name='tempest-ServerActionsTestOtherA-server-344031741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-979185243',id=21,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDr7ycWbe4a18QCutvpkP7CWIG7sFeN9yLq+Fk/+9la9FZ2+WrmjN1SrIaq9M5vapNsgXhY/fqJ+zVC2xw49y0ephiZ/bKzdZoGG4k3f4lcfIHaaq0HpH7+wgK2/e4Lsg==',key_name='tempest-keypair-1072437854',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-8pqov304',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=ca93842d-f13f-4b73-8e2e-06da55cdc8bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "b77cb74f-4900-4123-9977-e70738850ef2", "address": "fa:16:3e:d4:08:ee", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77cb74f-49", "ovs_interfaceid": "b77cb74f-4900-4123-9977-e70738850ef2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG os_vif [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb77cb74f-49, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:27 user nova-compute[72929]: INFO os_vif [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:08:ee,bridge_name='br-int',has_traffic_filtering=True,id=b77cb74f-4900-4123-9977-e70738850ef2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77cb74f-49')
Aug 26 22:10:27 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Deleting instance files /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc_del
Aug 26 22:10:27 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Deletion of /opt/stack/data/nova/instances/ca93842d-f13f-4b73-8e2e-06da55cdc8bc_del complete
Aug 26 22:10:27 user nova-compute[72929]: INFO nova.compute.manager [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 26 22:10:27 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 387ba104-895e-433c-a100-51b98acf8c15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 9749ba34-28ea-4e7f-8f3e-a99e61e1acee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:10:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=14GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:28 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Took 0.82 seconds to deallocate network for instance.
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-2bd95480-419f-44f7-9011-020569a00884 req-ce168eff-6d76-4d3c-b213-6d7e3c67c869 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-deleted-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-2ba19e22-ef85-45f6-815e-71ce2a0757da req-9c5908e9-c637-472b-85e4-879bf9f76224 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2ba19e22-ef85-45f6-815e-71ce2a0757da req-9c5908e9-c637-472b-85e4-879bf9f76224 service nova] Acquiring lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2ba19e22-ef85-45f6-815e-71ce2a0757da req-9c5908e9-c637-472b-85e4-879bf9f76224 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2ba19e22-ef85-45f6-815e-71ce2a0757da req-9c5908e9-c637-472b-85e4-879bf9f76224 service nova] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-2ba19e22-ef85-45f6-815e-71ce2a0757da req-9c5908e9-c637-472b-85e4-879bf9f76224 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] No waiting events found dispatching network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:28 user nova-compute[72929]: WARNING nova.compute.manager [req-2ba19e22-ef85-45f6-815e-71ce2a0757da req-9c5908e9-c637-472b-85e4-879bf9f76224 service nova] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Received unexpected event network-vif-plugged-b77cb74f-4900-4123-9977-e70738850ef2 for instance with vm_state deleted and task_state None.
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:29 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Deleted allocations for instance ca93842d-f13f-4b73-8e2e-06da55cdc8bc
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40ab2219-804f-4345-b7cf-4a4d425cd50c tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "ca93842d-f13f-4b73-8e2e-06da55cdc8bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.766s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [{"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-17b027b1-b249-4fc9-a8f5-43e0cf919525" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:10:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:10:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:10:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquired lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:10:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:10:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'info_cache' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:30 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Releasing lock "refresh_cache-a0172f33-06bb-404d-8fb0-c88927e84bdd" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:10:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance destroyed successfully.
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'resources' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG os_vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a501758-13, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:10:31 user nova-compute[72929]: INFO os_vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13')
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start _get_guest_xml network_info=[{"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'numa_topology' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:10:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'pci_devices' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:10:31 user nova-compute[72929]:   <uuid>a0172f33-06bb-404d-8fb0-c88927e84bdd</uuid>
Aug 26 22:10:31 user nova-compute[72929]:   <name>instance-00000011</name>
Aug 26 22:10:31 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:10:31 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:10:31 user nova-compute[72929]:   <metadata>
Aug 26 22:10:31 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:10:31 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:10:31 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeTestJSON-server-669557141</nova:name>
Aug 26 22:10:31 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:10:31</nova:creationTime>
Aug 26 22:10:31 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:10:31 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:10:31 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:10:31 user nova-compute[72929]:       <nova:owner>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:user uuid="c8e8fa1fcb0b4fa5aac66bdeee20b647">tempest-AttachVolumeTestJSON-1023625544-project-member</nova:user>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:project uuid="675048d1f37047e1bb05a2619fac538f">tempest-AttachVolumeTestJSON-1023625544</nova:project>
Aug 26 22:10:31 user nova-compute[72929]:       </nova:owner>
Aug 26 22:10:31 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:10:31 user nova-compute[72929]:       <nova:ports>
Aug 26 22:10:31 user nova-compute[72929]:         <nova:port uuid="0a501758-13fe-41e5-b210-355d69b6e7b8">
Aug 26 22:10:31 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:10:31 user nova-compute[72929]:         </nova:port>
Aug 26 22:10:31 user nova-compute[72929]:       </nova:ports>
Aug 26 22:10:31 user nova-compute[72929]:     </nova:instance>
Aug 26 22:10:31 user nova-compute[72929]:   </metadata>
Aug 26 22:10:31 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:10:31 user nova-compute[72929]:     <system>
Aug 26 22:10:31 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:10:31 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:10:31 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:10:31 user nova-compute[72929]:       <entry name="serial">a0172f33-06bb-404d-8fb0-c88927e84bdd</entry>
Aug 26 22:10:31 user nova-compute[72929]:       <entry name="uuid">a0172f33-06bb-404d-8fb0-c88927e84bdd</entry>
Aug 26 22:10:31 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:10:31 user nova-compute[72929]:     </system>
Aug 26 22:10:31 user nova-compute[72929]:   </sysinfo>
Aug 26 22:10:31 user nova-compute[72929]:   <os>
Aug 26 22:10:31 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:10:31 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:10:31 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:10:31 user nova-compute[72929]:   </os>
Aug 26 22:10:31 user nova-compute[72929]:   <features>
Aug 26 22:10:31 user nova-compute[72929]:     <acpi/>
Aug 26 22:10:31 user nova-compute[72929]:     <apic/>
Aug 26 22:10:31 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:10:31 user nova-compute[72929]:   </features>
Aug 26 22:10:31 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:10:31 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:10:31 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:10:31 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:10:31 user nova-compute[72929]:   </clock>
Aug 26 22:10:31 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:10:31 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:10:31 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:10:31 user nova-compute[72929]:   </cpu>
Aug 26 22:10:31 user nova-compute[72929]:   <devices>
Aug 26 22:10:31 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:10:31 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:10:31 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk"/>
Aug 26 22:10:31 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:10:31 user nova-compute[72929]:     </disk>
Aug 26 22:10:31 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:10:31 user nova-compute[72929]:       <mac address="fa:16:3e:e0:4c:2b"/>
Aug 26 22:10:31 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:10:31 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:10:31 user nova-compute[72929]:       <target dev="tap0a501758-13"/>
Aug 26 22:10:31 user nova-compute[72929]:     </interface>
Aug 26 22:10:31 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:10:31 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/console.log" append="off"/>
Aug 26 22:10:31 user nova-compute[72929]:     </serial>
Aug 26 22:10:31 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:10:31 user nova-compute[72929]:     <video>
Aug 26 22:10:31 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:10:31 user nova-compute[72929]:     </video>
Aug 26 22:10:31 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:10:31 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:10:31 user nova-compute[72929]:     </rng>
Aug 26 22:10:31 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:10:31 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:10:31 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:10:31 user nova-compute[72929]:     </memballoon>
Aug 26 22:10:31 user nova-compute[72929]:   </devices>
Aug 26 22:10:31 user nova-compute[72929]: </domain>
Aug 26 22:10:31 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Cannot resize image /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'migration_context' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.objects.base [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Object Instance<a0172f33-06bb-404d-8fb0-c88927e84bdd> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:08:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG os_vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a501758-13, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a501758-13, col_values=(('external_ids', {'iface-id': '0a501758-13fe-41e5-b210-355d69b6e7b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:4c:2b', 'vm-uuid': 'a0172f33-06bb-404d-8fb0-c88927e84bdd'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:10:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:32 user nova-compute[72929]: INFO os_vif [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13')
Aug 26 22:10:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-02dabb10-5b75-4ad8-8905-dedc6db38a0e req-ffad020d-8ea2-4300-a56a-80f2953493f3 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02dabb10-5b75-4ad8-8905-dedc6db38a0e req-ffad020d-8ea2-4300-a56a-80f2953493f3 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02dabb10-5b75-4ad8-8905-dedc6db38a0e req-ffad020d-8ea2-4300-a56a-80f2953493f3 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-02dabb10-5b75-4ad8-8905-dedc6db38a0e req-ffad020d-8ea2-4300-a56a-80f2953493f3 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-02dabb10-5b75-4ad8-8905-dedc6db38a0e req-ffad020d-8ea2-4300-a56a-80f2953493f3 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:33 user nova-compute[72929]: WARNING nova.compute.manager [req-02dabb10-5b75-4ad8-8905-dedc6db38a0e req-ffad020d-8ea2-4300-a56a-80f2953493f3 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state stopped and task_state powering-on.
Aug 26 22:10:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087835.8412704, a0172f33-06bb-404d-8fb0-c88927e84bdd => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Resumed (Lifecycle Event)
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:10:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance rebooted successfully.
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e987f19b-6744-4769-bbcb-0f7b14109f68 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:10:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087835.8462927, a0172f33-06bb-404d-8fb0-c88927e84bdd => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Started (Lifecycle Event)
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-ab67bd87-10fe-46c1-b12c-3d7d6c3bc8c7 req-202b0203-5b5c-4df7-b4d4-fd58cbc6f509 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab67bd87-10fe-46c1-b12c-3d7d6c3bc8c7 req-202b0203-5b5c-4df7-b4d4-fd58cbc6f509 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab67bd87-10fe-46c1-b12c-3d7d6c3bc8c7 req-202b0203-5b5c-4df7-b4d4-fd58cbc6f509 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ab67bd87-10fe-46c1-b12c-3d7d6c3bc8c7 req-202b0203-5b5c-4df7-b4d4-fd58cbc6f509 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-ab67bd87-10fe-46c1-b12c-3d7d6c3bc8c7 req-202b0203-5b5c-4df7-b4d4-fd58cbc6f509 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:35 user nova-compute[72929]: WARNING nova.compute.manager [req-ab67bd87-10fe-46c1-b12c-3d7d6c3bc8c7 req-202b0203-5b5c-4df7-b4d4-fd58cbc6f509 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state active and task_state None.
Aug 26 22:10:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:42 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087827.2752342, ca93842d-f13f-4b73-8e2e-06da55cdc8bc => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:10:42 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] VM Stopped (Lifecycle Event)
Aug 26 22:10:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a8e3ab9f-6d33-4168-8479-f27f2659cfe6 None None] [instance: ca93842d-f13f-4b73-8e2e-06da55cdc8bc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:10:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:45 user nova-compute[72929]: INFO nova.compute.manager [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Terminating instance
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-7a3f40f7-1957-4d43-a348-a19ae2b4b5c3 req-a7b801a9-eda4-4bfa-847c-15dfbd4cda0a service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-unplugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7a3f40f7-1957-4d43-a348-a19ae2b4b5c3 req-a7b801a9-eda4-4bfa-847c-15dfbd4cda0a service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7a3f40f7-1957-4d43-a348-a19ae2b4b5c3 req-a7b801a9-eda4-4bfa-847c-15dfbd4cda0a service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7a3f40f7-1957-4d43-a348-a19ae2b4b5c3 req-a7b801a9-eda4-4bfa-847c-15dfbd4cda0a service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-7a3f40f7-1957-4d43-a348-a19ae2b4b5c3 req-a7b801a9-eda4-4bfa-847c-15dfbd4cda0a service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-unplugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-7a3f40f7-1957-4d43-a348-a19ae2b4b5c3 req-a7b801a9-eda4-4bfa-847c-15dfbd4cda0a service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-unplugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:10:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Instance destroyed successfully.
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.objects.instance [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lazy-loading 'resources' on Instance uuid 387ba104-895e-433c-a100-51b98acf8c15 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:05:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-738784921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-738784921',id=23,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPfNpwEcgMoxwh1kvGHHdd6/D1xmuG4A8l5F1mE9k0yQA+NLV/dyW1tqMh/GoiJ6T8r1WS8RAWQueqpULpn/3q31K80VMxZGdCgH1yzS/MrTzni1jf6oYHlcdq6HAQdZg==',key_name='tempest-keypair-1698526643',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:09:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='22dd3139d0af4e319ee02bff3155650b',ramdisk_id='',reservation_id='r-ujoxx46c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1476482184',owner_user_name='tempest-AttachVolumeShelveTestJSON-1476482184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf32662e1a4e466781518d4fdd63cb76',uuid=387ba104-895e-433c-a100-51b98acf8c15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converting VIF {"id": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "address": "fa:16:3e:e1:be:fe", "network": {"id": "086e20a2-2b86-4057-936b-832c0a5850e0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-262577706-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "22dd3139d0af4e319ee02bff3155650b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31f5f5c0-90", "ovs_interfaceid": "31f5f5c0-90be-4968-af17-b2fa7ea45f29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG os_vif [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31f5f5c0-90, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:10:45 user nova-compute[72929]: INFO os_vif [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:be:fe,bridge_name='br-int',has_traffic_filtering=True,id=31f5f5c0-90be-4968-af17-b2fa7ea45f29,network=Network(086e20a2-2b86-4057-936b-832c0a5850e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31f5f5c0-90')
Aug 26 22:10:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Deleting instance files /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15_del
Aug 26 22:10:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Deletion of /opt/stack/data/nova/instances/387ba104-895e-433c-a100-51b98acf8c15_del complete
Aug 26 22:10:45 user nova-compute[72929]: INFO nova.compute.manager [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 26 22:10:45 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:10:45 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:10:47 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Took 1.52 seconds to deallocate network for instance.
Aug 26 22:10:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-1695f8eb-10ce-4b24-8334-5eb646ddcb60 req-e5a963fe-4dc3-4b6a-886f-81b6e5e311f1 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-deleted-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-8f8d452a-5a5e-4fd5-a543-bbde3add9918 req-c0b8e9d9-2f1b-4fe0-a7a8-2f65cbe55635 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8f8d452a-5a5e-4fd5-a543-bbde3add9918 req-c0b8e9d9-2f1b-4fe0-a7a8-2f65cbe55635 service nova] Acquiring lock "387ba104-895e-433c-a100-51b98acf8c15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8f8d452a-5a5e-4fd5-a543-bbde3add9918 req-c0b8e9d9-2f1b-4fe0-a7a8-2f65cbe55635 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8f8d452a-5a5e-4fd5-a543-bbde3add9918 req-c0b8e9d9-2f1b-4fe0-a7a8-2f65cbe55635 service nova] Lock "387ba104-895e-433c-a100-51b98acf8c15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-8f8d452a-5a5e-4fd5-a543-bbde3add9918 req-c0b8e9d9-2f1b-4fe0-a7a8-2f65cbe55635 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] No waiting events found dispatching network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:10:47 user nova-compute[72929]: WARNING nova.compute.manager [req-8f8d452a-5a5e-4fd5-a543-bbde3add9918 req-c0b8e9d9-2f1b-4fe0-a7a8-2f65cbe55635 service nova] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Received unexpected event network-vif-plugged-31f5f5c0-90be-4968-af17-b2fa7ea45f29 for instance with vm_state deleted and task_state None.
Aug 26 22:10:47 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:47 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Deleted allocations for instance 387ba104-895e-433c-a100-51b98acf8c15
Aug 26 22:10:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-86904d3d-b39f-45d3-9c97-4aa75ab497a9 tempest-AttachVolumeShelveTestJSON-1476482184 tempest-AttachVolumeShelveTestJSON-1476482184-project-member] Lock "387ba104-895e-433c-a100-51b98acf8c15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.768s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:10:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:10:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:00 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087845.759479, 387ba104-895e-433c-a100-51b98acf8c15 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:11:00 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 387ba104-895e-433c-a100-51b98acf8c15] VM Stopped (Lifecycle Event)
Aug 26 22:11:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7cdca60-5811-4966-9621-f1204fa47039 None None] [instance: 387ba104-895e-433c-a100-51b98acf8c15] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:11:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:11 user nova-compute[72929]: INFO nova.compute.manager [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Terminating instance
Aug 26 22:11:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:11 user nova-compute[72929]: INFO nova.compute.manager [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Terminating instance
Aug 26 22:11:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-70f20570-cf94-4531-a1f0-2f6339d163cb req-ebd84b63-8f96-4f4d-b663-74206cbb7a77 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-vif-unplugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-70f20570-cf94-4531-a1f0-2f6339d163cb req-ebd84b63-8f96-4f4d-b663-74206cbb7a77 service nova] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-70f20570-cf94-4531-a1f0-2f6339d163cb req-ebd84b63-8f96-4f4d-b663-74206cbb7a77 service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-70f20570-cf94-4531-a1f0-2f6339d163cb req-ebd84b63-8f96-4f4d-b663-74206cbb7a77 service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-70f20570-cf94-4531-a1f0-2f6339d163cb req-ebd84b63-8f96-4f4d-b663-74206cbb7a77 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] No waiting events found dispatching network-vif-unplugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-70f20570-cf94-4531-a1f0-2f6339d163cb req-ebd84b63-8f96-4f4d-b663-74206cbb7a77 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-vif-unplugged-83803bcc-34a6-4643-9504-d57bedac1035 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Instance destroyed successfully.
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.objects.instance [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lazy-loading 'resources' on Instance uuid 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:09:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-334830801',display_name='tempest-VolumesActionsTest-instance-334830801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-334830801',id=29,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:09:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3a729ec8b2e46909a2f4084ccc8a347',ramdisk_id='',reservation_id='r-kkx0kjwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-170522998',owner_user_name='tempest-VolumesActionsTest-170522998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:09:15Z,user_data=None,user_id='58ec50e583e84c07a7be2f882403326e',uuid=7c968ba9-39e0-4d57-ad3d-b4ed483b03f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Converting VIF {"id": "83803bcc-34a6-4643-9504-d57bedac1035", "address": "fa:16:3e:c9:4f:1f", "network": {"id": "ebc545cf-7a89-4381-b0bc-15ebdb8cfd13", "bridge": "br-int", "label": "tempest-VolumesActionsTest-864167484-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3a729ec8b2e46909a2f4084ccc8a347", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83803bcc-34", "ovs_interfaceid": "83803bcc-34a6-4643-9504-d57bedac1035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG os_vif [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83803bcc-34, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: INFO os_vif [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4f:1f,bridge_name='br-int',has_traffic_filtering=True,id=83803bcc-34a6-4643-9504-d57bedac1035,network=Network(ebc545cf-7a89-4381-b0bc-15ebdb8cfd13),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83803bcc-34')
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Deleting instance files /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6_del
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Deletion of /opt/stack/data/nova/instances/7c968ba9-39e0-4d57-ad3d-b4ed483b03f6_del complete
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-b4a26124-293f-4827-9420-2045b41fb2cd req-35205614-e7db-46ed-9cde-10622d5f9947 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-vif-unplugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b4a26124-293f-4827-9420-2045b41fb2cd req-35205614-e7db-46ed-9cde-10622d5f9947 service nova] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b4a26124-293f-4827-9420-2045b41fb2cd req-35205614-e7db-46ed-9cde-10622d5f9947 service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b4a26124-293f-4827-9420-2045b41fb2cd req-35205614-e7db-46ed-9cde-10622d5f9947 service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-b4a26124-293f-4827-9420-2045b41fb2cd req-35205614-e7db-46ed-9cde-10622d5f9947 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] No waiting events found dispatching network-vif-unplugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-b4a26124-293f-4827-9420-2045b41fb2cd req-35205614-e7db-46ed-9cde-10622d5f9947 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-vif-unplugged-69f58484-9f9b-4835-b269-644441508b83 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.compute.manager [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Instance destroyed successfully.
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.objects.instance [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lazy-loading 'resources' on Instance uuid 9cfedc10-54d5-4ce0-8d15-9f0d23361489 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1851072362',display_name='tempest-AttachVolumeNegativeTest-server-1851072362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1851072362',id=27,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNe6x7FOuZJWYsiAY0CZcEzEej+ucCcEmodTjiP6Y2FpCSoNfYZU48pdhOwdqq3C1OHBayCXEmgAFHVy+9zJ7rUFcSrZujpGWi29xWBDq/1LDxMfyycGSbju440pY9FAng==',key_name='tempest-keypair-1645245032',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a593fe9fb7a442f08880ecd2fab42df6',ramdisk_id='',reservation_id='r-k0x04n4i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-600362177',owner_user_name='tempest-AttachVolumeNegativeTest-600362177-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ef1bea627245e29428b442787db7b7',uuid=9cfedc10-54d5-4ce0-8d15-9f0d23361489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converting VIF {"id": "69f58484-9f9b-4835-b269-644441508b83", "address": "fa:16:3e:4a:39:b4", "network": {"id": "4c7cca42-b174-4ba1-8f21-2cdd7a4a6308", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-258252624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a593fe9fb7a442f08880ecd2fab42df6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f58484-9f", "ovs_interfaceid": "69f58484-9f9b-4835-b269-644441508b83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG os_vif [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69f58484-9f, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:12 user nova-compute[72929]: INFO os_vif [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:39:b4,bridge_name='br-int',has_traffic_filtering=True,id=69f58484-9f9b-4835-b269-644441508b83,network=Network(4c7cca42-b174-4ba1-8f21-2cdd7a4a6308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f58484-9f')
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Deleting instance files /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489_del
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Deletion of /opt/stack/data/nova/instances/9cfedc10-54d5-4ce0-8d15-9f0d23361489_del complete
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.compute.manager [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Took 0.48 seconds to deallocate network for instance.
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ca859de7-e010-41bd-811c-d2af44cb68b6 req-e331eb26-17f5-490b-a52c-49b682c4d0f9 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-vif-deleted-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:12 user nova-compute[72929]: INFO nova.compute.manager [req-ca859de7-e010-41bd-811c-d2af44cb68b6 req-e331eb26-17f5-490b-a52c-49b682c4d0f9 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Neutron deleted interface 83803bcc-34a6-4643-9504-d57bedac1035; detaching it from the instance and deleting it from the info cache
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.network.neutron [req-ca859de7-e010-41bd-811c-d2af44cb68b6 req-e331eb26-17f5-490b-a52c-49b682c4d0f9 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-ca859de7-e010-41bd-811c-d2af44cb68b6 req-e331eb26-17f5-490b-a52c-49b682c4d0f9 service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Detach interface failed, port_id=83803bcc-34a6-4643-9504-d57bedac1035, reason: Instance 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:13 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:11:13 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:11:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:13 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Deleted allocations for instance 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6
Aug 26 22:11:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-72951610-a59e-4260-b2f3-f1344f5488cd tempest-VolumesActionsTest-170522998 tempest-VolumesActionsTest-170522998-project-member] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:13 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:11:13 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Took 1.02 seconds to deallocate network for instance.
Aug 26 22:11:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-231f86f9-699c-4c60-9ac9-f48001903914 req-71812b5f-f25e-4d80-8d7b-14b4e32c9adb service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received event network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-231f86f9-699c-4c60-9ac9-f48001903914 req-71812b5f-f25e-4d80-8d7b-14b4e32c9adb service nova] Acquiring lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-231f86f9-699c-4c60-9ac9-f48001903914 req-71812b5f-f25e-4d80-8d7b-14b4e32c9adb service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-231f86f9-699c-4c60-9ac9-f48001903914 req-71812b5f-f25e-4d80-8d7b-14b4e32c9adb service nova] Lock "7c968ba9-39e0-4d57-ad3d-b4ed483b03f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-231f86f9-699c-4c60-9ac9-f48001903914 req-71812b5f-f25e-4d80-8d7b-14b4e32c9adb service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] No waiting events found dispatching network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:11:14 user nova-compute[72929]: WARNING nova.compute.manager [req-231f86f9-699c-4c60-9ac9-f48001903914 req-71812b5f-f25e-4d80-8d7b-14b4e32c9adb service nova] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Received unexpected event network-vif-plugged-83803bcc-34a6-4643-9504-d57bedac1035 for instance with vm_state deleted and task_state None.
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:14 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Deleted allocations for instance 9cfedc10-54d5-4ce0-8d15-9f0d23361489
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-69c0f25c-c98a-409f-afe3-11d210eef189 tempest-AttachVolumeNegativeTest-600362177 tempest-AttachVolumeNegativeTest-600362177-project-member] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.421s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] Acquiring lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] Lock "9cfedc10-54d5-4ce0-8d15-9f0d23361489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] No waiting events found dispatching network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:11:14 user nova-compute[72929]: WARNING nova.compute.manager [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received unexpected event network-vif-plugged-69f58484-9f9b-4835-b269-644441508b83 for instance with vm_state deleted and task_state None.
Aug 26 22:11:14 user nova-compute[72929]: DEBUG nova.compute.manager [req-9b6bd058-f0b7-4108-b2d9-07dc5f0aa7bd req-ed2aa3a4-e7b0-4a2b-871b-9360983008c1 service nova] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Received event network-vif-deleted-69f58484-9f9b-4835-b269-644441508b83 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:27 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:11:27 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7179MB free_disk=24.188968658447266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087872.28986, 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:11:27 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] VM Stopped (Lifecycle Event)
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance a0172f33-06bb-404d-8fb0-c88927e84bdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 9749ba34-28ea-4e7f-8f3e-a99e61e1acee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-808680bf-1825-461e-aedd-163a47ce5fa8 None None] [instance: 7c968ba9-39e0-4d57-ad3d-b4ed483b03f6] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087872.7092614, 9cfedc10-54d5-4ce0-8d15-9f0d23361489 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:11:27 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] VM Stopped (Lifecycle Event)
Aug 26 22:11:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ba2a7b01-e305-4d83-9527-557e9a12ce30 None None] [instance: 9cfedc10-54d5-4ce0-8d15-9f0d23361489] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:11:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:11:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Updating instance_info_cache with network_info: [{"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:11:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:11:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:11:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:11:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:11:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing instance network info cache due to event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG nova.network.neutron [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:52 user nova-compute[72929]: INFO nova.compute.manager [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Detaching volume 3db27446-b610-4a9c-a04d-2045bc02d7c2
Aug 26 22:11:53 user nova-compute[72929]: INFO nova.virt.block_device [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Attempting to driver detach volume 3db27446-b610-4a9c-a04d-2045bc02d7c2 from mountpoint /dev/vdb
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Attempting to detach device vdb from instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:11:53 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:11:53 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:11:53 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:11:53 user nova-compute[72929]:   <serial>3db27446-b610-4a9c-a04d-2045bc02d7c2</serial>
Aug 26 22:11:53 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:11:53 user nova-compute[72929]: </disk>
Aug 26 22:11:53 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:11:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully detached device vdb from instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf from the persistent domain config.
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:11:53 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:11:53 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:11:53 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:11:53 user nova-compute[72929]:   <serial>3db27446-b610-4a9c-a04d-2045bc02d7c2</serial>
Aug 26 22:11:53 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:11:53 user nova-compute[72929]: </disk>
Aug 26 22:11:53 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updated VIF entry in instance network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e3f9d1f1-cfaa-416e-9ea4-8a65baf67d5a req-40b8b46b-0fed-42cd-9a81-818b7e5ef3cb service nova] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693087913.5135539, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:11:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully detached device vdb from instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf from the live domain config.
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lJXNLxdc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:11:53 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ef23e1-d0be-4179-8760-98e06133cf1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cde4afb-1c08-4dcc-97cc-b20075f6b308]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:11:53 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:11:53 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 (non-flash)
Aug 26 22:11:53 user nova-compute[72929]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:11:53 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803ce3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a93ba2-b0d8-4db5-b740-da8e07de2f9a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c76d05-f070-4a3b-aa6b-cc49df0b6397]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc8903c-d831-40fe-9052-1d9f192be411]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[959c9a7c-841b-4692-b564-5e6729f181ea]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[25601624-c23e-4984-99aa-e7146fb27e79]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a3fb92-a7c5-45fe-ba88-8eb2d6c5cd5c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260]
Aug 26 22:11:53 user nova-compute[72929]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2, portal: 172.16.0.220,3260] successful.
Aug 26 22:11:53 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db27446-b610-4a9c-a04d-2045bc02d7c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3181b0-788e-4497-8bac-7dd6feeb50a6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] <== disconnect_volume: return (271ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:11:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'flavor' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing instance network info cache due to event network-changed-30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] Acquiring lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] Acquired lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG nova.network.neutron [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Refreshing network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:11:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1ccb5265-acc5-4d53-9be5-abb8c3f35237 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:11:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updated VIF entry in instance network info cache for port 30fff5ce-e634-4d69-bba7-e77ac1190ee2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:11:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [{"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:11:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a3b81192-1a0a-4a1e-bf47-36857a6c96f7 req-3323965d-80cc-40eb-8c72-b7fbd03d3178 service nova] Releasing lock "refresh_cache-f16261bd-823d-4d47-9f2e-f33c0c03cfdf" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG nova.objects.instance [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'flavor' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:11:56 user nova-compute[72929]: INFO nova.compute.manager [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Attaching volume 5bc42200-a2d1-4e83-932f-08e9011e8acf to /dev/vdb
Aug 26 22:11:56 user nova-compute[72929]: DEBUG os_brick.utils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d124940-9eaa-41be-b5a0-10f6d5baf19c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791dc07-4ef3-4d02-bed3-92328c2f6123]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6af45c-debc-443a-8417-3ebb24fd9056]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde757d-4a30-4dc9-9f40-23f1b82f1aeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:11:57 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:11:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06a1606-001a-4174-8d64-6bf02f395a0b]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG os_brick.utils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating existing volume attachment record: cde1873f-8c49-4f9c-872b-067063bbcb40 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:11:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:00 user nova-compute[72929]: INFO nova.compute.manager [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Terminating instance
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-a66563c7-6f98-4a3d-9882-33400e24a158 req-0bc5fb5f-0e03-4b92-be91-3ee307e453ef service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-vif-unplugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a66563c7-6f98-4a3d-9882-33400e24a158 req-0bc5fb5f-0e03-4b92-be91-3ee307e453ef service nova] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a66563c7-6f98-4a3d-9882-33400e24a158 req-0bc5fb5f-0e03-4b92-be91-3ee307e453ef service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a66563c7-6f98-4a3d-9882-33400e24a158 req-0bc5fb5f-0e03-4b92-be91-3ee307e453ef service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-a66563c7-6f98-4a3d-9882-33400e24a158 req-0bc5fb5f-0e03-4b92-be91-3ee307e453ef service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] No waiting events found dispatching network-vif-unplugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-a66563c7-6f98-4a3d-9882-33400e24a158 req-0bc5fb5f-0e03-4b92-be91-3ee307e453ef service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-vif-unplugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:12:00 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Instance destroyed successfully.
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lazy-loading 'resources' on Instance uuid 9749ba34-28ea-4e7f-8f3e-a99e61e1acee {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:10:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-143785799',display_name='tempest-VolumesActionsTest-instance-143785799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-143785799',id=30,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:10:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c8342795a1fd4e0da2e3bd1bb7599281',ramdisk_id='',reservation_id='r-8fdect0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1243309740',owner_user_name='tempest-VolumesActionsTest-1243309740-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:10:11Z,user_data=None,user_id='7e6d3ec106b9413f8879d505213b3466',uuid=9749ba34-28ea-4e7f-8f3e-a99e61e1acee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converting VIF {"id": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "address": "fa:16:3e:83:de:cf", "network": {"id": "fc82925a-8d1f-4011-b66d-bdab865e17af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-295361925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c8342795a1fd4e0da2e3bd1bb7599281", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7328f1c9-75", "ovs_interfaceid": "7328f1c9-7557-48a9-ae12-e5c10bc03516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG os_vif [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7328f1c9-75, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:12:00 user nova-compute[72929]: INFO os_vif [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:cf,bridge_name='br-int',has_traffic_filtering=True,id=7328f1c9-7557-48a9-ae12-e5c10bc03516,network=Network(fc82925a-8d1f-4011-b66d-bdab865e17af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7328f1c9-75')
Aug 26 22:12:00 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Deleting instance files /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee_del
Aug 26 22:12:00 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Deletion of /opt/stack/data/nova/instances/9749ba34-28ea-4e7f-8f3e-a99e61e1acee_del complete
Aug 26 22:12:01 user nova-compute[72929]: INFO nova.compute.manager [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 26 22:12:01 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:12:01 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:12:01 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:12:01 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:01 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Took 0.75 seconds to deallocate network for instance.
Aug 26 22:12:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-fd891552-4445-464d-83a2-22ebd5a6c9c3 req-e43ebab8-a9be-4e61-bd7b-9a1abb924d09 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-vif-deleted-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:01 user nova-compute[72929]: INFO nova.compute.manager [req-fd891552-4445-464d-83a2-22ebd5a6c9c3 req-e43ebab8-a9be-4e61-bd7b-9a1abb924d09 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Neutron deleted interface 7328f1c9-7557-48a9-ae12-e5c10bc03516; detaching it from the instance and deleting it from the info cache
Aug 26 22:12:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-fd891552-4445-464d-83a2-22ebd5a6c9c3 req-e43ebab8-a9be-4e61-bd7b-9a1abb924d09 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-fd891552-4445-464d-83a2-22ebd5a6c9c3 req-e43ebab8-a9be-4e61-bd7b-9a1abb924d09 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Detach interface failed, port_id=7328f1c9-7557-48a9-ae12-e5c10bc03516, reason: Instance 9749ba34-28ea-4e7f-8f3e-a99e61e1acee could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:12:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:02 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Deleted allocations for instance 9749ba34-28ea-4e7f-8f3e-a99e61e1acee
Aug 26 22:12:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e9cb9eab-3094-42d9-bbdb-dfb84268561b tempest-VolumesActionsTest-1243309740 tempest-VolumesActionsTest-1243309740-project-member] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-bb3e7db6-076b-4243-a452-f09112458921 req-1849bf9e-a10a-4de4-ad7d-dfb0317a0c25 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received event network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bb3e7db6-076b-4243-a452-f09112458921 req-1849bf9e-a10a-4de4-ad7d-dfb0317a0c25 service nova] Acquiring lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bb3e7db6-076b-4243-a452-f09112458921 req-1849bf9e-a10a-4de4-ad7d-dfb0317a0c25 service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bb3e7db6-076b-4243-a452-f09112458921 req-1849bf9e-a10a-4de4-ad7d-dfb0317a0c25 service nova] Lock "9749ba34-28ea-4e7f-8f3e-a99e61e1acee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-bb3e7db6-076b-4243-a452-f09112458921 req-1849bf9e-a10a-4de4-ad7d-dfb0317a0c25 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] No waiting events found dispatching network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:02 user nova-compute[72929]: WARNING nova.compute.manager [req-bb3e7db6-076b-4243-a452-f09112458921 req-1849bf9e-a10a-4de4-ad7d-dfb0317a0c25 service nova] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Received unexpected event network-vif-plugged-7328f1c9-7557-48a9-ae12-e5c10bc03516 for instance with vm_state deleted and task_state None.
Aug 26 22:12:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eETAJWhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:12:09 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:12:09 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:12:09 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a46ffd-e8f5-4a83-b55f-086e5a445a6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:12:09 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8775aac1-4d6b-49f1-9a5a-76703f892840]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf] added
Aug 26 22:12:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27317ae5-ce65-40bf-a148-3378b3fcad88]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[579837a0-0d2f-4dbb-8ff2-868255049097]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eETAJWhM {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eETAJWhM" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd6c97-58c9-439d-9b0c-2330ca0c3fee]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eETAJWhM'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[df771730-7caf-4687-bf4f-bc9558ea23b2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2de9388-7c1a-4954-8c1e-51db032cbc1c]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a8a37c-7edb-4937-a9ae-dd9455f99023]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260]
Aug 26 22:12:09 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260] successful.
Aug 26 22:12:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a583bd5-15c4-434b-b05e-1d6764eb14b8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e277e73-c8fc-4ab5-b0c9-924edb6bef80]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:09 user nova-compute[72929]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:12:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:09 user nova-compute[72929]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:12:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3afb11-573b-4dbb-bb55-8918e2fc8c57]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:10 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:12:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eETAJWhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23036333036356435', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036333036356435', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'flavor' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:12:11 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:12:11 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:12:11 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:12:11 user nova-compute[72929]:   <serial>5bc42200-a2d1-4e83-932f-08e9011e8acf</serial>
Aug 26 22:12:11 user nova-compute[72929]: </disk>
Aug 26 22:12:11 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No VIF found with MAC fa:16:3e:8a:10:02, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:12:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a9a5b32c-81b0-4d28-86e9-e51ed4e5b508 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.787s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:12 user nova-compute[72929]: INFO nova.compute.manager [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Rescuing
Aug 26 22:12:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:12:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:12:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:12:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-a3a7ffe0-f85b-4b99-b410-bc662457bdf3 req-c601e759-828e-4ab9-8f50-32063b93f876 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a3a7ffe0-f85b-4b99-b410-bc662457bdf3 req-c601e759-828e-4ab9-8f50-32063b93f876 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a3a7ffe0-f85b-4b99-b410-bc662457bdf3 req-c601e759-828e-4ab9-8f50-32063b93f876 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a3a7ffe0-f85b-4b99-b410-bc662457bdf3 req-c601e759-828e-4ab9-8f50-32063b93f876 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-a3a7ffe0-f85b-4b99-b410-bc662457bdf3 req-c601e759-828e-4ab9-8f50-32063b93f876 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:13 user nova-compute[72929]: WARNING nova.compute.manager [req-a3a7ffe0-f85b-4b99-b410-bc662457bdf3 req-c601e759-828e-4ab9-8f50-32063b93f876 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state active and task_state rescuing.
Aug 26 22:12:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance destroyed successfully.
Aug 26 22:12:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Attempting a stable device rescue
Aug 26 22:12:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72929) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:12:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Creating image(s)
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'trusted_certs' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "af854739c4dc31a42356791069713919bccaa59d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "af854739c4dc31a42356791069713919bccaa59d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.part --force-share --output=json" returned: 0 in 0.228s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.virt.images [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] 50a1d6e6-680a-4019-8e9a-0900580a7fec was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.part /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-10031697-5d97-4cb7-924d-cada696f4ab4 req-05c2b134-1b18-4771-b069-721224b41ab2 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10031697-5d97-4cb7-924d-cada696f4ab4 req-05c2b134-1b18-4771-b069-721224b41ab2 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10031697-5d97-4cb7-924d-cada696f4ab4 req-05c2b134-1b18-4771-b069-721224b41ab2 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-10031697-5d97-4cb7-924d-cada696f4ab4 req-05c2b134-1b18-4771-b069-721224b41ab2 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-10031697-5d97-4cb7-924d-cada696f4ab4 req-05c2b134-1b18-4771-b069-721224b41ab2 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:15 user nova-compute[72929]: WARNING nova.compute.manager [req-10031697-5d97-4cb7-924d-cada696f4ab4 req-05c2b134-1b18-4771-b069-721224b41ab2 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state active and task_state rescuing.
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.part /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.converted" returned: 0 in 0.383s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:15 user nova-compute[72929]: INFO nova.compute.manager [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Terminating instance
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "af854739c4dc31a42356791069713919bccaa59d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.788s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "af854739c4dc31a42356791069713919bccaa59d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "af854739c4dc31a42356791069713919bccaa59d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d,backing_fmt=raw /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087920.8648162, 9749ba34-28ea-4e7f-8f3e-a99e61e1acee => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:12:15 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] VM Stopped (Lifecycle Event)
Aug 26 22:12:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d,backing_fmt=raw /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue" returned: 0 in 0.071s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "af854739c4dc31a42356791069713919bccaa59d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'migration_context' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-90ead56f-e788-43d4-a6ef-eb4f68fc00ca None None] [instance: 9749ba34-28ea-4e7f-8f3e-a99e61e1acee] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b691bf50-34bc-4406-8537-b9e9b3d106ca req-587c2f8a-3157-4bf0-8d7c-863416afcb2a service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b691bf50-34bc-4406-8537-b9e9b3d106ca req-587c2f8a-3157-4bf0-8d7c-863416afcb2a service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b691bf50-34bc-4406-8537-b9e9b3d106ca req-587c2f8a-3157-4bf0-8d7c-863416afcb2a service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b691bf50-34bc-4406-8537-b9e9b3d106ca req-587c2f8a-3157-4bf0-8d7c-863416afcb2a service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b691bf50-34bc-4406-8537-b9e9b3d106ca req-587c2f8a-3157-4bf0-8d7c-863416afcb2a service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-b691bf50-34bc-4406-8537-b9e9b3d106ca req-587c2f8a-3157-4bf0-8d7c-863416afcb2a service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-unplugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.objects.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Object Instance<51939e0e-26e5-4a6c-9f85-a294036fd456> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Start _get_guest_xml network_info=[{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "vif_mac": "fa:16:3e:8a:10:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '50a1d6e6-680a-4019-8e9a-0900580a7fec', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'cde1873f-8c49-4f9c-872b-067063bbcb40', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eETAJWhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '51939e0e-26e5-4a6c-9f85-a294036fd456', 'attached_at': '', 'detached_at': '', 'volume_id': '5bc42200-a2d1-4e83-932f-08e9011e8acf', 'serial': '5bc42200-a2d1-4e83-932f-08e9011e8acf'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'resources' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.objects.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Object Instance<51939e0e-26e5-4a6c-9f85-a294036fd456> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:12:15 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'numa_topology' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.objects.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Object Instance<51939e0e-26e5-4a6c-9f85-a294036fd456> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:12:16 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:12:16 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'vcpu_model' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.objects.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Object Instance<51939e0e-26e5-4a6c-9f85-a294036fd456> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eETAJWhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:12:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:12:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:12:16 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cd5dfb-9451-441e-9db2-4e1a5a350649]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = eETAJWhM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 22:12:16 user nova-compute[72929]: node.name = iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf
Aug 26 22:12:16 user nova-compute[72929]: node.tpgt = -1
Aug 26 22:12:16 user nova-compute[72929]: node.startup = automatic
Aug 26 22:12:16 user nova-compute[72929]: node.leading_login = No
Aug 26 22:12:16 user nova-compute[72929]: iface.iscsi_ifacename = default
Aug 26 22:12:16 user nova-compute[72929]: iface.net_ifacename = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.ipaddress = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.prefix_len = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.hwaddress = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.transport_name = tcp
Aug 26 22:12:16 user nova-compute[72929]: iface.initiatorname = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.vlan_id = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.vlan_priority = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.vlan_state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.iface_num = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.mtu = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.port = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.bootproto = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.subnet_mask = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.gateway = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_alt_client_id = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_dns = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_learn_iqn = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_vendor_id_state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_vendor_id = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.dhcp_slp_da = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.fragmentation = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.gratuitous_arp = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.incoming_forwarding = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.tos_state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.tos = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.ttl = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.delayed_ack = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.tcp_nagle = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.tcp_wsf_state = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.tcp_wsf = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.tcp_timer_scale = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.tcp_timestamp = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.redirect = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.def_task_mgmt_timeout = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.header_digest = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.data_digest = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.immediate_data = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.initial_r2t = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.data_seq_inorder = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.data_pdu_inorder = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.erl = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.max_receive_data_len = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.first_burst_len = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.max_outstanding_r2t = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.max_burst_len = 0
Aug 26 22:12:16 user nova-compute[72929]: iface.chap_auth = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.bidi_chap = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.strict_login_compliance = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.discovery_auth = <empty>
Aug 26 22:12:16 user nova-compute[72929]: iface.discovery_logout = <empty>
Aug 26 22:12:16 user nova-compute[72929]: node.discovery_address = <empty>
Aug 26 22:12:16 user nova-compute[72929]: node.discovery_port = 0
Aug 26 22:12:16 user nova-compute[72929]: node.discovery_type = static
Aug 26 22:12:16 user nova-compute[72929]: node.session.initial_cmdsn = 0
Aug 26 22:12:16 user nova-compute[72929]: node.session.initial_login_retry_max = 8
Aug 26 22:12:16 user nova-compute[72929]: node.session.xmit_thread_priority = -20
Aug 26 22:12:16 user nova-compute[72929]: node.session.cmds_max = 128
Aug 26 22:12:16 user nova-compute[72929]: node.session.queue_depth = 32
Aug 26 22:12:16 user nova-compute[72929]: node.session.nr_sessions = 1
Aug 26 22:12:16 user nova-compute[72929]: node.session.auth.authmethod = CHAP
Aug 26 22:12:16 user nova-compute[72929]: node.session.auth.username = eETAJWhM
Aug 26 22:12:16 user nova-compute[72929]: node.session.auth.password = ***
Aug 26 22:12:16 user nova-compute[72929]: node.session.auth.username_in = <empty>
Aug 26 22:12:16 user nova-compute[72929]: node.session.auth.password_in = <empty>
Aug 26 22:12:16 user nova-compute[72929]: node.session.auth.chap_algs = MD5
Aug 26 22:12:16 user nova-compute[72929]: node.session.timeo.replacement_timeout = 120
Aug 26 22:12:16 user nova-compute[72929]: node.session.err_timeo.abort_timeout = 15
Aug 26 22:12:16 user nova-compute[72929]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 22:12:16 user nova-compute[72929]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 22:12:16 user nova-compute[72929]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.FastAbort = Yes
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.InitialR2T = No
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.ImmediateData = Yes
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.MaxConnections = 1
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 22:12:16 user nova-compute[72929]: node.session.iscsi.ERL = 0
Aug 26 22:12:16 user nova-compute[72929]: node.session.scan = manual
Aug 26 22:12:16 user nova-compute[72929]: node.session.reopen_max = 0
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].address = 172.16.0.220
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].port = 3260
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].startup = manual
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].tcp.window_size = 524288
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].tcp.type_of_service = 0
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].timeo.logout_timeout = 15
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].timeo.login_timeout = 15
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].timeo.auth_timeout = 45
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].iscsi.DataDigest = None
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].iscsi.IFMarker = No
Aug 26 22:12:16 user nova-compute[72929]: node.conn[0].iscsi.OFMarker = No
Aug 26 22:12:16 user nova-compute[72929]: # END RECORD
Aug 26 22:12:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2711ae26-3610-4f78-9000-1f6069ff86cd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[98570579-0ff4-45b0-b2f8-fe9de5b1968d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eETAJWhM {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eETAJWhM" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbb5ff0-ddd0-43d2-8066-064c4ebaf30f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eETAJWhM'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffedd4f-460c-41cc-985d-f44375fb8769]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe6ed89-5490-46e4-a762-9a395735f2f3]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:16 user nova-compute[72929]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:12:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:16 user nova-compute[72929]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:12:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefccbe0-b357-4f44-ad58-1629c919008f]: (4, ('0 0 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eETAJWhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.202s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '23036333036356435', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036333036356435', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:12:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Instance destroyed successfully.
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lazy-loading 'resources' on Instance uuid 17b027b1-b249-4fc9-a8f5-43e0cf919525 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1992218640',display_name='tempest-ServerActionsTestOtherB-server-1992218640',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1992218640',id=19,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtoiuM+I2LksgNFqzomRoGg5NASPTgScxJdEoFEKn5889E/SD78oDQTfFpAAp89Tsvww0ktCc9i4pLTncTPOyrsN2TkwJs3JlpYnx7Kzh1E4UT5Gg2CZDxDW950olPdWw==',key_name='tempest-keypair-457162631',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:09:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7f712c6e7e418caa20ca971c810660',ramdisk_id='',reservation_id='r-kqgll6te',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-381550606',owner_user_name='tempest-ServerActionsTestOtherB-381550606-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:09:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c6aeec78644486ba130cf6084d76887',uuid=17b027b1-b249-4fc9-a8f5-43e0cf919525,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converting VIF {"id": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "address": "fa:16:3e:4b:0f:09", "network": {"id": "7cc4f3de-f395-41a2-b935-3fd9c7f8ba37", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-997311350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7f712c6e7e418caa20ca971c810660", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a8d4c8c-26", "ovs_interfaceid": "7a8d4c8c-2672-4af8-b42e-54be12e2544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_vif [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-307271181',display_name='tempest-ServerStableDeviceRescueTest-server-307271181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-307271181',id=28,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaQrMpX5D3/D0f5rMRJs05UxwQ4nOPNwd8wSykXIZBFClehKfGl3vJt5kyJy81nVsRMnLuoYuKgJOKXGIqk89oUeud5z/WKozXn+ryW8yrqW1gFfILXb152Y/ToR42/eQ==',key_name='tempest-keypair-994409064',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9b1c93b18e2422783401f0c73fe6390',ramdisk_id='',reservation_id='r-x02l0mvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1771134667',owner_user_name='tempest-ServerStableDeviceRescueTest-1771134667-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:10:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ad44b98452d41a89c4d14747f2a6036',uuid=51939e0e-26e5-4a6c-9f85-a294036fd456,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "vif_mac": "fa:16:3e:8a:10:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converting VIF {"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "vif_mac": "fa:16:3e:8a:10:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'pci_devices' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a8d4c8c-26, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.objects.base [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Object Instance<51939e0e-26e5-4a6c-9f85-a294036fd456> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:12:16 user nova-compute[72929]:   <uuid>51939e0e-26e5-4a6c-9f85-a294036fd456</uuid>
Aug 26 22:12:16 user nova-compute[72929]:   <name>instance-0000001c</name>
Aug 26 22:12:16 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:12:16 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:12:16 user nova-compute[72929]:   <metadata>
Aug 26 22:12:16 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:12:16 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:12:16 user nova-compute[72929]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-307271181</nova:name>
Aug 26 22:12:16 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:12:16</nova:creationTime>
Aug 26 22:12:16 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:12:16 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:12:16 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:12:16 user nova-compute[72929]:       <nova:owner>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:user uuid="2ad44b98452d41a89c4d14747f2a6036">tempest-ServerStableDeviceRescueTest-1771134667-project-member</nova:user>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:project uuid="d9b1c93b18e2422783401f0c73fe6390">tempest-ServerStableDeviceRescueTest-1771134667</nova:project>
Aug 26 22:12:16 user nova-compute[72929]:       </nova:owner>
Aug 26 22:12:16 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:12:16 user nova-compute[72929]:       <nova:ports>
Aug 26 22:12:16 user nova-compute[72929]:         <nova:port uuid="36a6c019-2580-4d4b-8223-6ec70a6c0046">
Aug 26 22:12:16 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:12:16 user nova-compute[72929]:         </nova:port>
Aug 26 22:12:16 user nova-compute[72929]:       </nova:ports>
Aug 26 22:12:16 user nova-compute[72929]:     </nova:instance>
Aug 26 22:12:16 user nova-compute[72929]:   </metadata>
Aug 26 22:12:16 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:12:16 user nova-compute[72929]:     <system>
Aug 26 22:12:16 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:12:16 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:12:16 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:12:16 user nova-compute[72929]:       <entry name="serial">51939e0e-26e5-4a6c-9f85-a294036fd456</entry>
Aug 26 22:12:16 user nova-compute[72929]:       <entry name="uuid">51939e0e-26e5-4a6c-9f85-a294036fd456</entry>
Aug 26 22:12:16 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:12:16 user nova-compute[72929]:     </system>
Aug 26 22:12:16 user nova-compute[72929]:   </sysinfo>
Aug 26 22:12:16 user nova-compute[72929]:   <os>
Aug 26 22:12:16 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:12:16 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:12:16 user nova-compute[72929]:   </os>
Aug 26 22:12:16 user nova-compute[72929]:   <features>
Aug 26 22:12:16 user nova-compute[72929]:     <acpi/>
Aug 26 22:12:16 user nova-compute[72929]:     <apic/>
Aug 26 22:12:16 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:12:16 user nova-compute[72929]:   </features>
Aug 26 22:12:16 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:12:16 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:12:16 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:12:16 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:12:16 user nova-compute[72929]:   </clock>
Aug 26 22:12:16 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:12:16 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:12:16 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:12:16 user nova-compute[72929]:   </cpu>
Aug 26 22:12:16 user nova-compute[72929]:   <devices>
Aug 26 22:12:16 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:12:16 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:12:16 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk"/>
Aug 26 22:12:16 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:12:16 user nova-compute[72929]:     </disk>
Aug 26 22:12:16 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:12:16 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:12:16 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:12:16 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:12:16 user nova-compute[72929]:       <serial>5bc42200-a2d1-4e83-932f-08e9011e8acf</serial>
Aug 26 22:12:16 user nova-compute[72929]:     </disk>
Aug 26 22:12:16 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:12:16 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:12:16 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue"/>
Aug 26 22:12:16 user nova-compute[72929]:       <target dev="vdc" bus="virtio"/>
Aug 26 22:12:16 user nova-compute[72929]:       <boot order="1"/>
Aug 26 22:12:16 user nova-compute[72929]:     </disk>
Aug 26 22:12:16 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:12:16 user nova-compute[72929]:       <mac address="fa:16:3e:8a:10:02"/>
Aug 26 22:12:16 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:12:16 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:12:16 user nova-compute[72929]:       <target dev="tap36a6c019-25"/>
Aug 26 22:12:16 user nova-compute[72929]:     </interface>
Aug 26 22:12:16 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:12:16 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/console.log" append="off"/>
Aug 26 22:12:16 user nova-compute[72929]:     </serial>
Aug 26 22:12:16 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:12:16 user nova-compute[72929]:     <video>
Aug 26 22:12:16 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:12:16 user nova-compute[72929]:     </video>
Aug 26 22:12:16 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:12:16 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:12:16 user nova-compute[72929]:     </rng>
Aug 26 22:12:16 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:12:16 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:12:16 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:12:16 user nova-compute[72929]:     </memballoon>
Aug 26 22:12:16 user nova-compute[72929]:   </devices>
Aug 26 22:12:16 user nova-compute[72929]: </domain>
Aug 26 22:12:16 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:12:16 user nova-compute[72929]: INFO os_vif [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:0f:09,bridge_name='br-int',has_traffic_filtering=True,id=7a8d4c8c-2672-4af8-b42e-54be12e2544e,network=Network(7cc4f3de-f395-41a2-b935-3fd9c7f8ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a8d4c8c-26')
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xnYesQmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:12:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance destroyed successfully.
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da6d891-9264-49eb-852f-0c5194ecfe2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d63205-f70d-4bea-a9b4-9a9948dfef89]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:16 user nova-compute[72929]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:12:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 (non-flash)
Aug 26 22:12:16 user nova-compute[72929]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:12:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804d3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78410de-8109-434d-b072-00a9cb171a72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] No VIF found with MAC fa:16:3e:8a:10:02, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adf3fab-927e-4e1f-bff7-9b0c56174e2d]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fea3d52-ecdc-4687-8f4e-72450e18ad9c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ff96b1-8330-4d6b-833a-7d1924a5defa]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b1102d-da97-442a-a7f3-5fdf69becc6e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431125a-7733-485b-bbbc-b74a673ad870]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260]
Aug 26 22:12:16 user nova-compute[72929]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94, portal: 172.16.0.220,3260] successful.
Aug 26 22:12:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92166bc6-ef7b-4f1c-8eb8-3ba5118fcd94 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bd1fc3-1dda-481f-b47f-ceabaee4610c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] <== disconnect_volume: return (317ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:12:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Deleting instance files /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525_del
Aug 26 22:12:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Deletion of /opt/stack/data/nova/instances/17b027b1-b249-4fc9-a8f5-43e0cf919525_del complete
Aug 26 22:12:16 user nova-compute[72929]: INFO nova.compute.manager [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 26 22:12:16 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:12:16 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:12:17 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-7a2cbb98-6506-4907-8454-f2bdb386bc45 req-befc80b0-e124-49e8-aa77-787409b573f1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-deleted-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:17 user nova-compute[72929]: INFO nova.compute.manager [req-7a2cbb98-6506-4907-8454-f2bdb386bc45 req-befc80b0-e124-49e8-aa77-787409b573f1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Neutron deleted interface 7a8d4c8c-2672-4af8-b42e-54be12e2544e; detaching it from the instance and deleting it from the info cache
Aug 26 22:12:17 user nova-compute[72929]: DEBUG nova.network.neutron [req-7a2cbb98-6506-4907-8454-f2bdb386bc45 req-befc80b0-e124-49e8-aa77-787409b573f1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:17 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Took 1.02 seconds to deallocate network for instance.
Aug 26 22:12:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-7a2cbb98-6506-4907-8454-f2bdb386bc45 req-befc80b0-e124-49e8-aa77-787409b573f1 service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Detach interface failed, port_id=7a8d4c8c-2672-4af8-b42e-54be12e2544e, reason: Instance 17b027b1-b249-4fc9-a8f5-43e0cf919525 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:12:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-83e747a8-b2a2-47cf-a86e-b74b9f6b240a req-073d0eba-9779-49c9-9dd1-78995753620d service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-83e747a8-b2a2-47cf-a86e-b74b9f6b240a req-073d0eba-9779-49c9-9dd1-78995753620d service nova] Acquiring lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-83e747a8-b2a2-47cf-a86e-b74b9f6b240a req-073d0eba-9779-49c9-9dd1-78995753620d service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-83e747a8-b2a2-47cf-a86e-b74b9f6b240a req-073d0eba-9779-49c9-9dd1-78995753620d service nova] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-83e747a8-b2a2-47cf-a86e-b74b9f6b240a req-073d0eba-9779-49c9-9dd1-78995753620d service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] No waiting events found dispatching network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:18 user nova-compute[72929]: WARNING nova.compute.manager [req-83e747a8-b2a2-47cf-a86e-b74b9f6b240a req-073d0eba-9779-49c9-9dd1-78995753620d service nova] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Received unexpected event network-vif-plugged-7a8d4c8c-2672-4af8-b42e-54be12e2544e for instance with vm_state active and task_state deleting.
Aug 26 22:12:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:19 user nova-compute[72929]: INFO nova.compute.manager [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Took 1.34 seconds to detach 1 volumes for instance.
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:19 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Deleted allocations for instance 17b027b1-b249-4fc9-a8f5-43e0cf919525
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1117b576-0828-46ed-8300-0c9bd5da2eae tempest-ServerActionsTestOtherB-381550606 tempest-ServerActionsTestOtherB-381550606-project-member] Lock "17b027b1-b249-4fc9-a8f5-43e0cf919525" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.329s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:19 user nova-compute[72929]: WARNING nova.compute.manager [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state active and task_state rescuing.
Aug 26 22:12:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:19 user nova-compute[72929]: WARNING nova.compute.manager [req-9ea1ecad-d8b6-4219-b55e-2266a5e03bf8 req-3cdb8f5c-aae5-4ff2-bbf5-5a5d8720b5a8 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state active and task_state rescuing.
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 51939e0e-26e5-4a6c-9f85-a294036fd456 due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087940.5279534, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:12:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Resumed (Lifecycle Event)
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4491e7ea-638b-4c17-b175-43b1c5ef3d1a tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:12:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693087940.5330284, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:12:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Started (Lifecycle Event)
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:12:20 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 22:12:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:22 user nova-compute[72929]: INFO nova.compute.manager [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Terminating instance
Aug 26 22:12:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-48ab145d-26f0-4858-9b1c-cbb1ad8d9d17 req-1d28c461-132f-49e4-a7cc-5d6dac038cbc service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-48ab145d-26f0-4858-9b1c-cbb1ad8d9d17 req-1d28c461-132f-49e4-a7cc-5d6dac038cbc service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-48ab145d-26f0-4858-9b1c-cbb1ad8d9d17 req-1d28c461-132f-49e4-a7cc-5d6dac038cbc service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-48ab145d-26f0-4858-9b1c-cbb1ad8d9d17 req-1d28c461-132f-49e4-a7cc-5d6dac038cbc service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-48ab145d-26f0-4858-9b1c-cbb1ad8d9d17 req-1d28c461-132f-49e4-a7cc-5d6dac038cbc service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-48ab145d-26f0-4858-9b1c-cbb1ad8d9d17 req-1d28c461-132f-49e4-a7cc-5d6dac038cbc service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-unplugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:12:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Instance destroyed successfully.
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'resources' on Instance uuid a0172f33-06bb-404d-8fb0-c88927e84bdd {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-669557141',display_name='tempest-AttachVolumeTestJSON-server-669557141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-669557141',id=17,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3rX6hK9gE/Ih5W5eC8B1aQ0Ii7rHaPMxi6sfeIxSEVi8K3+HDcbHRgGGRJ2o6Dn9b0NHu2E4PGgCOJ0fpDNbZTICGNb8ppSghqqfQWxpmj1O76cnKFo3fGH3bhHdu7/g==',key_name='tempest-keypair-1055919059',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-ef7v00t0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:10:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=a0172f33-06bb-404d-8fb0-c88927e84bdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "0a501758-13fe-41e5-b210-355d69b6e7b8", "address": "fa:16:3e:e0:4c:2b", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a501758-13", "ovs_interfaceid": "0a501758-13fe-41e5-b210-355d69b6e7b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG os_vif [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a501758-13, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:23 user nova-compute[72929]: INFO os_vif [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:4c:2b,bridge_name='br-int',has_traffic_filtering=True,id=0a501758-13fe-41e5-b210-355d69b6e7b8,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a501758-13')
Aug 26 22:12:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Deleting instance files /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd_del
Aug 26 22:12:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Deletion of /opt/stack/data/nova/instances/a0172f33-06bb-404d-8fb0-c88927e84bdd_del complete
Aug 26 22:12:23 user nova-compute[72929]: INFO nova.compute.manager [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-23766c60-5bc9-49bd-93a9-704548fc117e req-686c806b-00f3-47ae-9495-c735670d8370 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23766c60-5bc9-49bd-93a9-704548fc117e req-686c806b-00f3-47ae-9495-c735670d8370 service nova] Acquiring lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23766c60-5bc9-49bd-93a9-704548fc117e req-686c806b-00f3-47ae-9495-c735670d8370 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23766c60-5bc9-49bd-93a9-704548fc117e req-686c806b-00f3-47ae-9495-c735670d8370 service nova] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-23766c60-5bc9-49bd-93a9-704548fc117e req-686c806b-00f3-47ae-9495-c735670d8370 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] No waiting events found dispatching network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:24 user nova-compute[72929]: WARNING nova.compute.manager [req-23766c60-5bc9-49bd-93a9-704548fc117e req-686c806b-00f3-47ae-9495-c735670d8370 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received unexpected event network-vif-plugged-0a501758-13fe-41e5-b210-355d69b6e7b8 for instance with vm_state active and task_state deleting.
Aug 26 22:12:24 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-071ef387-1d1c-4493-990e-6e8423380188 req-074a5ba4-5e53-488a-8d2a-6546282e95e9 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Received event network-vif-deleted-0a501758-13fe-41e5-b210-355d69b6e7b8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:24 user nova-compute[72929]: INFO nova.compute.manager [req-071ef387-1d1c-4493-990e-6e8423380188 req-074a5ba4-5e53-488a-8d2a-6546282e95e9 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Neutron deleted interface 0a501758-13fe-41e5-b210-355d69b6e7b8; detaching it from the instance and deleting it from the info cache
Aug 26 22:12:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-071ef387-1d1c-4493-990e-6e8423380188 req-074a5ba4-5e53-488a-8d2a-6546282e95e9 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:24 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Took 1.58 seconds to deallocate network for instance.
Aug 26 22:12:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-071ef387-1d1c-4493-990e-6e8423380188 req-074a5ba4-5e53-488a-8d2a-6546282e95e9 service nova] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Detach interface failed, port_id=0a501758-13fe-41e5-b210-355d69b6e7b8, reason: Instance a0172f33-06bb-404d-8fb0-c88927e84bdd could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:25 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Deleted allocations for instance a0172f33-06bb-404d-8fb0-c88927e84bdd
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-00fca7ad-2f46-4a37-8343-37d6a659012c tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "a0172f33-06bb-404d-8fb0-c88927e84bdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.398s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json" returned: 0 in 0.263s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:28 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:12:28 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=24.166378021240234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3db3d467-df63-4ea0-951b-4eee4460980f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:12:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:12:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:31 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087936.3029993, 17b027b1-b249-4fc9-a8f5-43e0cf919525 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:12:31 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] VM Stopped (Lifecycle Event)
Aug 26 22:12:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4c2e9f21-9c9b-428c-b878-a0609911f8f4 None None] [instance: 17b027b1-b249-4fc9-a8f5-43e0cf919525] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:12:33 user nova-compute[72929]: INFO nova.compute.claims [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Claim successful on node user
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:12:34 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:12:34 user nova-compute[72929]: INFO nova.virt.block_device [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Booting with volume 48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 at /dev/vda
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.policy [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93c597a2c99646f1bb79645380ce0b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e6cde0e448142e48abb9220470391f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG os_brick.utils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a340672-5a75-4364-a16f-ba9f39d472bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1542df-ac24-4441-9f84-6bf64614b611]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c5e43-2470-4a3d-9630-af83bb71e616]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc57f8-2ffb-45a9-965b-983136f4117b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:12:34 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:12:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e041d0-6594-4371-9d9b-6903e76e7c20]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG os_brick.utils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:12:34 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating existing volume attachment record: 4b8df3c8-4069-42d6-95c3-c79d7a19b05b {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:12:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Successfully created port: 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Successfully updated port: 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-changed-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Refreshing instance network info cache due to event network-changed-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance network_info: |[{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Refreshing network info cache for port 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updated VIF entry in instance network info cache for port 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:12:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-50a3b846-d5a8-4a86-8baa-6ea42a8b1651 req-ffc51b1f-ef68-4a21-b25e-50aaa72f908f service nova] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:12:38 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087943.0079577, a0172f33-06bb-404d-8fb0-c88927e84bdd => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:12:38 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] VM Stopped (Lifecycle Event)
Aug 26 22:12:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92bf7383-186d-49d6-97c5-301a387673dc None None] [instance: a0172f33-06bb-404d-8fb0-c88927e84bdd] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:43 user nova-compute[72929]: INFO nova.compute.manager [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Terminating instance
Aug 26 22:12:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-08779fb1-5f56-4f16-af84-19f1f44a56ce req-6e59c462-cdaa-4ec7-aaac-566c85d664c1 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-08779fb1-5f56-4f16-af84-19f1f44a56ce req-6e59c462-cdaa-4ec7-aaac-566c85d664c1 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-08779fb1-5f56-4f16-af84-19f1f44a56ce req-6e59c462-cdaa-4ec7-aaac-566c85d664c1 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-08779fb1-5f56-4f16-af84-19f1f44a56ce req-6e59c462-cdaa-4ec7-aaac-566c85d664c1 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-08779fb1-5f56-4f16-af84-19f1f44a56ce req-6e59c462-cdaa-4ec7-aaac-566c85d664c1 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-08779fb1-5f56-4f16-af84-19f1f44a56ce req-6e59c462-cdaa-4ec7-aaac-566c85d664c1 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-unplugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Instance destroyed successfully.
Aug 26 22:12:44 user nova-compute[72929]: DEBUG nova.objects.instance [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'resources' on Instance uuid f16261bd-823d-4d47-9f2e-f33c0c03cfdf {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1899681647',display_name='tempest-ServerRescueNegativeTestJSON-server-1899681647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1899681647',id=24,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmrnsPl9BCUz5gKi6NIGGc/WZfHCJpUkxNKj7/Gj13IimJduOfPMx5AAuMDtl6q2lQ2zDF7GwrYVa9bqba/vCby+DzGKrrDrrGXRxVHtS7xxJn2R2FxVmPEdZ2aAIFi5g==',key_name='tempest-keypair-1557050715',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:08:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-gj6izi2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c2dac68027a44a09a4deadab28f2981',uuid=f16261bd-823d-4d47-9f2e-f33c0c03cfdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "address": "fa:16:3e:72:b9:27", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fff5ce-e6", "ovs_interfaceid": "30fff5ce-e634-4d69-bba7-e77ac1190ee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG os_vif [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fff5ce-e6, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:12:44 user nova-compute[72929]: INFO os_vif [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:b9:27,bridge_name='br-int',has_traffic_filtering=True,id=30fff5ce-e634-4d69-bba7-e77ac1190ee2,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fff5ce-e6')
Aug 26 22:12:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Deleting instance files /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf_del
Aug 26 22:12:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Deletion of /opt/stack/data/nova/instances/f16261bd-823d-4d47-9f2e-f33c0c03cfdf_del complete
Aug 26 22:12:44 user nova-compute[72929]: INFO nova.compute.manager [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 26 22:12:44 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:12:44 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:45 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Took 0.92 seconds to deallocate network for instance.
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:45 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Deleted allocations for instance f16261bd-823d-4d47-9f2e-f33c0c03cfdf
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91b97430-19b1-4cc6-a79d-316cb9c01b0b tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.403s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] Acquiring lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] Lock "f16261bd-823d-4d47-9f2e-f33c0c03cfdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] No waiting events found dispatching network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:45 user nova-compute[72929]: WARNING nova.compute.manager [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received unexpected event network-vif-plugged-30fff5ce-e634-4d69-bba7-e77ac1190ee2 for instance with vm_state deleted and task_state None.
Aug 26 22:12:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-dff2351c-8654-423b-83b7-efffd669d8ba req-67f210db-21db-42f0-a83f-a74c248989b3 service nova] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Received event network-vif-deleted-30fff5ce-e634-4d69-bba7-e77ac1190ee2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:48 user nova-compute[72929]: INFO nova.compute.manager [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Terminating instance
Aug 26 22:12:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-8a9ad485-11a6-48ed-962d-d534ce483570 req-f5d32ce5-19a6-4180-8ef8-5f74318567b1 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-vif-unplugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8a9ad485-11a6-48ed-962d-d534ce483570 req-f5d32ce5-19a6-4180-8ef8-5f74318567b1 service nova] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8a9ad485-11a6-48ed-962d-d534ce483570 req-f5d32ce5-19a6-4180-8ef8-5f74318567b1 service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8a9ad485-11a6-48ed-962d-d534ce483570 req-f5d32ce5-19a6-4180-8ef8-5f74318567b1 service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-8a9ad485-11a6-48ed-962d-d534ce483570 req-f5d32ce5-19a6-4180-8ef8-5f74318567b1 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] No waiting events found dispatching network-vif-unplugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-8a9ad485-11a6-48ed-962d-d534ce483570 req-f5d32ce5-19a6-4180-8ef8-5f74318567b1 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-vif-unplugged-31cd2e68-b957-4024-80b2-43b64534d0d7 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:49 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Instance destroyed successfully.
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lazy-loading 'resources' on Instance uuid 3db3d467-df63-4ea0-951b-4eee4460980f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:02:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-426322740',display_name='tempest-SnapshotDataIntegrityTests-server-426322740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-426322740',id=15,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBX5AbESjnH3GeEP33a9zvWZiZY37tu/NbrO7/igCqy0oKnuyRFD1BnDcPt2ZnjN/sUlsKbr3Vn2l5yTVQHYg5tvvEV4MRgRSeizqUEYLxX+dypojVNLTbQw4is1ZHoyg==',key_name='tempest-keypair-754946778',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b52160357a438cbd3b6a5b03e19121',ramdisk_id='',reservation_id='r-dqqe9b2n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1852193928',owner_user_name='tempest-SnapshotDataIntegrityTests-1852193928-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44b0a9d8d4f46988219dd36ccb01f93',uuid=3db3d467-df63-4ea0-951b-4eee4460980f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Converting VIF {"id": "31cd2e68-b957-4024-80b2-43b64534d0d7", "address": "fa:16:3e:d1:91:3e", "network": {"id": "e39d51c7-abf2-477a-bfc7-019bb5097296", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-992194451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b52160357a438cbd3b6a5b03e19121", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31cd2e68-b9", "ovs_interfaceid": "31cd2e68-b957-4024-80b2-43b64534d0d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG os_vif [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31cd2e68-b9, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:12:49 user nova-compute[72929]: INFO os_vif [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:91:3e,bridge_name='br-int',has_traffic_filtering=True,id=31cd2e68-b957-4024-80b2-43b64534d0d7,network=Network(e39d51c7-abf2-477a-bfc7-019bb5097296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31cd2e68-b9')
Aug 26 22:12:49 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Deleting instance files /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f_del
Aug 26 22:12:49 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Deletion of /opt/stack/data/nova/instances/3db3d467-df63-4ea0-951b-4eee4460980f_del complete
Aug 26 22:12:49 user nova-compute[72929]: INFO nova.compute.manager [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 22:12:49 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:12:49 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-c30a5638-68c6-43de-af9f-78a21e77d2d3 req-e12efe31-9c11-424e-9c63-89eb8c387925 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-vif-deleted-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:50 user nova-compute[72929]: INFO nova.compute.manager [req-c30a5638-68c6-43de-af9f-78a21e77d2d3 req-e12efe31-9c11-424e-9c63-89eb8c387925 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Neutron deleted interface 31cd2e68-b957-4024-80b2-43b64534d0d7; detaching it from the instance and deleting it from the info cache
Aug 26 22:12:50 user nova-compute[72929]: DEBUG nova.network.neutron [req-c30a5638-68c6-43de-af9f-78a21e77d2d3 req-e12efe31-9c11-424e-9c63-89eb8c387925 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:12:50 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Took 0.86 seconds to deallocate network for instance.
Aug 26 22:12:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-c30a5638-68c6-43de-af9f-78a21e77d2d3 req-e12efe31-9c11-424e-9c63-89eb8c387925 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Detach interface failed, port_id=31cd2e68-b957-4024-80b2-43b64534d0d7, reason: Instance 3db3d467-df63-4ea0-951b-4eee4460980f could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:12:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:50 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Deleted allocations for instance 3db3d467-df63-4ea0-951b-4eee4460980f
Aug 26 22:12:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1f2d2945-802c-4dac-bf9a-21e4a2119765 tempest-SnapshotDataIntegrityTests-1852193928 tempest-SnapshotDataIntegrityTests-1852193928-project-member] Lock "3db3d467-df63-4ea0-951b-4eee4460980f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-b8306def-288f-452c-a173-2cf72ec5014c req-902b8b2c-9d7e-4a82-99cd-d28af08c5746 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received event network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:12:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b8306def-288f-452c-a173-2cf72ec5014c req-902b8b2c-9d7e-4a82-99cd-d28af08c5746 service nova] Acquiring lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:12:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b8306def-288f-452c-a173-2cf72ec5014c req-902b8b2c-9d7e-4a82-99cd-d28af08c5746 service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:12:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b8306def-288f-452c-a173-2cf72ec5014c req-902b8b2c-9d7e-4a82-99cd-d28af08c5746 service nova] Lock "3db3d467-df63-4ea0-951b-4eee4460980f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:12:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-b8306def-288f-452c-a173-2cf72ec5014c req-902b8b2c-9d7e-4a82-99cd-d28af08c5746 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] No waiting events found dispatching network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:12:51 user nova-compute[72929]: WARNING nova.compute.manager [req-b8306def-288f-452c-a173-2cf72ec5014c req-902b8b2c-9d7e-4a82-99cd-d28af08c5746 service nova] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Received unexpected event network-vif-plugged-31cd2e68-b957-4024-80b2-43b64534d0d7 for instance with vm_state deleted and task_state None.
Aug 26 22:12:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:12:59 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087964.220758, f16261bd-823d-4d47-9f2e-f33c0c03cfdf => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:12:59 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] VM Stopped (Lifecycle Event)
Aug 26 22:12:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-36510898-0a00-4bbc-85a4-8419bb34eb37 None None] [instance: f16261bd-823d-4d47-9f2e-f33c0c03cfdf] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:12:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:04 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693087969.5553493, 3db3d467-df63-4ea0-951b-4eee4460980f => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:04 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] VM Stopped (Lifecycle Event)
Aug 26 22:13:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-779e84c3-e7eb-40db-ae19-8567f82deb10 None None] [instance: 3db3d467-df63-4ea0-951b-4eee4460980f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:13:14 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Creating image(s)
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Ensure instance console log exists: /opt/stack/data/nova/instances/21b46025-5ff1-4bf1-a9a0-fd7a1549c705/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Start _get_guest_xml network_info=[{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '4b8df3c8-4069-42d6-95c3-c79d7a19b05b', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '21b46025-5ff1-4bf1-a9a0-fd7a1549c705', 'attached_at': '', 'detached_at': '', 'volume_id': '48e33df3-6b1c-4ce7-bca3-476fa6ce97b4', 'serial': '48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:13:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:13:14 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:13:14 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:13:14 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74ff8a-fe15-470c-b22f-2a8e0f50ec67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:13:14 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2641adb-8c58-4f58-9849-8cd5f69de150]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4] added
Aug 26 22:13:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c448b6-0749-46b1-b607-a48765ba7ba9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a79a13-468a-42f2-bde3-49c0464778ab]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCwhWQld {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCwhWQld" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5517d5-8a62-4141-a688-c38830177c0c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCwhWQld'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac223756-d884-4d34-b120-053f9e2ba0b5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[959dd41c-4911-408b-9851-e2667e903ab3]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43bb2d-1af9-464c-9846-1f39f4921a86 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:13:14 user nova-compute[72929]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43bb2d-1af9-464c-9846-1f39f4921a86 (non-flash)
Aug 26 22:13:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:13:14 user nova-compute[72929]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43bb2d-1af9-464c-9846-1f39f4921a86 (non-flash)
Aug 26 22:13:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.149s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83a0fd1-4ca6-45d7-b5bb-e01690e72190]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]
Aug 26 22:13:14 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.
Aug 26 22:13:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c5fe4e-922d-487d-82f9-a381fe27b572]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.106s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f04d4-7876-4397-bef9-0d48817594cc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43bb2d-1af9-464c-9846-1f39f4921a86 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:13:14 user nova-compute[72929]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43bb2d-1af9-464c-9846-1f39f4921a86 (non-flash)
Aug 26 22:13:14 user nova-compute[72929]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:13:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:13:14 user nova-compute[72929]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b43bb2d-1af9-464c-9846-1f39f4921a86 (non-flash)
Aug 26 22:13:14 user nova-compute[72929]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:13:14 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.495s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.089s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3790709d-a65b-49c9-9247-aa095772ce67]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:13:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:13:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.631s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:13:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== connect_volume: return (1633ms) {'type': 'block', 'scsi_wwn': '23031643036313632', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:13:15 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031643036313632', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038925650',display_name='tempest-ServerActionsTestOtherA-server-2038925650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2038925650',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-2r1jp5t6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=21b46025-5ff1-4bf1-a9a0-fd7a1549c705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'pci_devices' on Instance uuid 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:13:16 user nova-compute[72929]:   <uuid>21b46025-5ff1-4bf1-a9a0-fd7a1549c705</uuid>
Aug 26 22:13:16 user nova-compute[72929]:   <name>instance-0000001f</name>
Aug 26 22:13:16 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:13:16 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:13:16 user nova-compute[72929]:   <metadata>
Aug 26 22:13:16 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:13:16 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:13:16 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherA-server-2038925650</nova:name>
Aug 26 22:13:16 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:13:14</nova:creationTime>
Aug 26 22:13:16 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:13:16 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:13:16 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:13:16 user nova-compute[72929]:       <nova:owner>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:user uuid="93c597a2c99646f1bb79645380ce0b75">tempest-ServerActionsTestOtherA-1951554093-project-member</nova:user>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:project uuid="4e6cde0e448142e48abb9220470391f2">tempest-ServerActionsTestOtherA-1951554093</nova:project>
Aug 26 22:13:16 user nova-compute[72929]:       </nova:owner>
Aug 26 22:13:16 user nova-compute[72929]:       <nova:ports>
Aug 26 22:13:16 user nova-compute[72929]:         <nova:port uuid="08c2128c-77ab-47c8-a1a4-5ef5efaee1c2">
Aug 26 22:13:16 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 22:13:16 user nova-compute[72929]:         </nova:port>
Aug 26 22:13:16 user nova-compute[72929]:       </nova:ports>
Aug 26 22:13:16 user nova-compute[72929]:     </nova:instance>
Aug 26 22:13:16 user nova-compute[72929]:   </metadata>
Aug 26 22:13:16 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:13:16 user nova-compute[72929]:     <system>
Aug 26 22:13:16 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:13:16 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:13:16 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:13:16 user nova-compute[72929]:       <entry name="serial">21b46025-5ff1-4bf1-a9a0-fd7a1549c705</entry>
Aug 26 22:13:16 user nova-compute[72929]:       <entry name="uuid">21b46025-5ff1-4bf1-a9a0-fd7a1549c705</entry>
Aug 26 22:13:16 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:13:16 user nova-compute[72929]:     </system>
Aug 26 22:13:16 user nova-compute[72929]:   </sysinfo>
Aug 26 22:13:16 user nova-compute[72929]:   <os>
Aug 26 22:13:16 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:13:16 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:13:16 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:13:16 user nova-compute[72929]:   </os>
Aug 26 22:13:16 user nova-compute[72929]:   <features>
Aug 26 22:13:16 user nova-compute[72929]:     <acpi/>
Aug 26 22:13:16 user nova-compute[72929]:     <apic/>
Aug 26 22:13:16 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:13:16 user nova-compute[72929]:   </features>
Aug 26 22:13:16 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:13:16 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:13:16 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:13:16 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:13:16 user nova-compute[72929]:   </clock>
Aug 26 22:13:16 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:13:16 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:13:16 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:13:16 user nova-compute[72929]:   </cpu>
Aug 26 22:13:16 user nova-compute[72929]:   <devices>
Aug 26 22:13:16 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:13:16 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:13:16 user nova-compute[72929]:       <source dev="/dev/sdd"/>
Aug 26 22:13:16 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:13:16 user nova-compute[72929]:       <serial>48e33df3-6b1c-4ce7-bca3-476fa6ce97b4</serial>
Aug 26 22:13:16 user nova-compute[72929]:     </disk>
Aug 26 22:13:16 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:13:16 user nova-compute[72929]:       <mac address="fa:16:3e:7d:05:e6"/>
Aug 26 22:13:16 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:13:16 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:13:16 user nova-compute[72929]:       <target dev="tap08c2128c-77"/>
Aug 26 22:13:16 user nova-compute[72929]:     </interface>
Aug 26 22:13:16 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:13:16 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/21b46025-5ff1-4bf1-a9a0-fd7a1549c705/console.log" append="off"/>
Aug 26 22:13:16 user nova-compute[72929]:     </serial>
Aug 26 22:13:16 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:13:16 user nova-compute[72929]:     <video>
Aug 26 22:13:16 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:13:16 user nova-compute[72929]:     </video>
Aug 26 22:13:16 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:13:16 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:13:16 user nova-compute[72929]:     </rng>
Aug 26 22:13:16 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:13:16 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:13:16 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:13:16 user nova-compute[72929]:     </memballoon>
Aug 26 22:13:16 user nova-compute[72929]:   </devices>
Aug 26 22:13:16 user nova-compute[72929]: </domain>
Aug 26 22:13:16 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038925650',display_name='tempest-ServerActionsTestOtherA-server-2038925650',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2038925650',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-2r1jp5t6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:12:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=21b46025-5ff1-4bf1-a9a0-fd7a1549c705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG os_vif [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08c2128c-77, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08c2128c-77, col_values=(('external_ids', {'iface-id': '08c2128c-77ab-47c8-a1a4-5ef5efaee1c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:05:e6', 'vm-uuid': '21b46025-5ff1-4bf1-a9a0-fd7a1549c705'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:16 user nova-compute[72929]: INFO os_vif [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77')
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:13:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No VIF found with MAC fa:16:3e:7d:05:e6, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-fa5c5a93-fdbc-47ff-8570-e51187d41759 req-562cc5eb-e0f7-4c3d-ba04-1985b5db5b1c service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fa5c5a93-fdbc-47ff-8570-e51187d41759 req-562cc5eb-e0f7-4c3d-ba04-1985b5db5b1c service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fa5c5a93-fdbc-47ff-8570-e51187d41759 req-562cc5eb-e0f7-4c3d-ba04-1985b5db5b1c service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fa5c5a93-fdbc-47ff-8570-e51187d41759 req-562cc5eb-e0f7-4c3d-ba04-1985b5db5b1c service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-fa5c5a93-fdbc-47ff-8570-e51187d41759 req-562cc5eb-e0f7-4c3d-ba04-1985b5db5b1c service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:18 user nova-compute[72929]: WARNING nova.compute.manager [req-fa5c5a93-fdbc-47ff-8570-e51187d41759 req-562cc5eb-e0f7-4c3d-ba04-1985b5db5b1c service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state building and task_state spawning.
Aug 26 22:13:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-4e6956c0-e9e2-4881-8e34-c42f6e389b82 req-b4fa7540-8334-4f72-85cb-3e1b4a988c4a service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4e6956c0-e9e2-4881-8e34-c42f6e389b82 req-b4fa7540-8334-4f72-85cb-3e1b4a988c4a service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4e6956c0-e9e2-4881-8e34-c42f6e389b82 req-b4fa7540-8334-4f72-85cb-3e1b4a988c4a service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4e6956c0-e9e2-4881-8e34-c42f6e389b82 req-b4fa7540-8334-4f72-85cb-3e1b4a988c4a service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-4e6956c0-e9e2-4881-8e34-c42f6e389b82 req-b4fa7540-8334-4f72-85cb-3e1b4a988c4a service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:20 user nova-compute[72929]: WARNING nova.compute.manager [req-4e6956c0-e9e2-4881-8e34-c42f6e389b82 req-b4fa7540-8334-4f72-85cb-3e1b4a988c4a service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state building and task_state spawning.
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088001.3640192, 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] VM Resumed (Lifecycle Event)
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance spawned successfully.
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088001.3686142, 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] VM Started (Lifecycle Event)
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Took 7.27 seconds to spawn the instance on the hypervisor.
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.manager [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Took 48.14 seconds to build instance.
Aug 26 22:13:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c06842bc-0800-446c-847f-399019a482fe tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.334s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:21 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:13:21 user nova-compute[72929]: INFO nova.compute.claims [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Claim successful on node user
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.586s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:13:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.policy [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8e8fa1fcb0b4fa5aac66bdeee20b647', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '675048d1f37047e1bb05a2619fac538f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:13:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Creating image(s)
Aug 26 22:13:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "/opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "/opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.233s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk 1073741824" returned: 0 in 0.073s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.239s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Cannot resize image /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Ensure instance console log exists: /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:23 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Successfully created port: 2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:13:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Successfully updated port: 2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:13:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:13:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquired lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:13:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:13:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-changed-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Refreshing instance network info cache due to event network-changed-2d0c2da8-0185-47cf-970c-54f99f3d63e9. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] Acquiring lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updating instance_info_cache with network_info: [{"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Releasing lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Instance network_info: |[{"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] Acquired lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.network.neutron [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Refreshing network info cache for port 2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Start _get_guest_xml network_info=[{"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:13:25 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:25 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1878679145',display_name='tempest-AttachVolumeTestJSON-server-1878679145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1878679145',id=32,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM0CrzBlXYupSIF/nDamqPetdUmLnaTt2IZkXMQjS/EZUIFDu8cWKIhC9sD8wwpdsEB/3lE8LgbT08dncrwIUKA5rs+grEEX2NW73CO2NjT0a7WTwa0cAXPrU4LkRibPw==',key_name='tempest-keypair-1850158011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-rn93lam8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=7f3b60d4-d395-4859-9109-c2e052aebdb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:13:25 user nova-compute[72929]:   <uuid>7f3b60d4-d395-4859-9109-c2e052aebdb9</uuid>
Aug 26 22:13:25 user nova-compute[72929]:   <name>instance-00000020</name>
Aug 26 22:13:25 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:13:25 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:13:25 user nova-compute[72929]:   <metadata>
Aug 26 22:13:25 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:13:25 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:13:25 user nova-compute[72929]:       <nova:name>tempest-AttachVolumeTestJSON-server-1878679145</nova:name>
Aug 26 22:13:25 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:13:25</nova:creationTime>
Aug 26 22:13:25 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:13:25 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:13:25 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:13:25 user nova-compute[72929]:       <nova:owner>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:user uuid="c8e8fa1fcb0b4fa5aac66bdeee20b647">tempest-AttachVolumeTestJSON-1023625544-project-member</nova:user>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:project uuid="675048d1f37047e1bb05a2619fac538f">tempest-AttachVolumeTestJSON-1023625544</nova:project>
Aug 26 22:13:25 user nova-compute[72929]:       </nova:owner>
Aug 26 22:13:25 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:13:25 user nova-compute[72929]:       <nova:ports>
Aug 26 22:13:25 user nova-compute[72929]:         <nova:port uuid="2d0c2da8-0185-47cf-970c-54f99f3d63e9">
Aug 26 22:13:25 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:13:25 user nova-compute[72929]:         </nova:port>
Aug 26 22:13:25 user nova-compute[72929]:       </nova:ports>
Aug 26 22:13:25 user nova-compute[72929]:     </nova:instance>
Aug 26 22:13:25 user nova-compute[72929]:   </metadata>
Aug 26 22:13:25 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:13:25 user nova-compute[72929]:     <system>
Aug 26 22:13:25 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:13:25 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:13:25 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:13:25 user nova-compute[72929]:       <entry name="serial">7f3b60d4-d395-4859-9109-c2e052aebdb9</entry>
Aug 26 22:13:25 user nova-compute[72929]:       <entry name="uuid">7f3b60d4-d395-4859-9109-c2e052aebdb9</entry>
Aug 26 22:13:25 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:13:25 user nova-compute[72929]:     </system>
Aug 26 22:13:25 user nova-compute[72929]:   </sysinfo>
Aug 26 22:13:25 user nova-compute[72929]:   <os>
Aug 26 22:13:25 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:13:25 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:13:25 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:13:25 user nova-compute[72929]:   </os>
Aug 26 22:13:25 user nova-compute[72929]:   <features>
Aug 26 22:13:25 user nova-compute[72929]:     <acpi/>
Aug 26 22:13:25 user nova-compute[72929]:     <apic/>
Aug 26 22:13:25 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:13:25 user nova-compute[72929]:   </features>
Aug 26 22:13:25 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:13:25 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:13:25 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:13:25 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:13:25 user nova-compute[72929]:   </clock>
Aug 26 22:13:25 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:13:25 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:13:25 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:13:25 user nova-compute[72929]:   </cpu>
Aug 26 22:13:25 user nova-compute[72929]:   <devices>
Aug 26 22:13:25 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:13:25 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:13:25 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk"/>
Aug 26 22:13:25 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:13:25 user nova-compute[72929]:     </disk>
Aug 26 22:13:25 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:13:25 user nova-compute[72929]:       <mac address="fa:16:3e:7a:97:51"/>
Aug 26 22:13:25 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:13:25 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:13:25 user nova-compute[72929]:       <target dev="tap2d0c2da8-01"/>
Aug 26 22:13:25 user nova-compute[72929]:     </interface>
Aug 26 22:13:25 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:13:25 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/console.log" append="off"/>
Aug 26 22:13:25 user nova-compute[72929]:     </serial>
Aug 26 22:13:25 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:13:25 user nova-compute[72929]:     <video>
Aug 26 22:13:25 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:13:25 user nova-compute[72929]:     </video>
Aug 26 22:13:25 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:13:25 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:13:25 user nova-compute[72929]:     </rng>
Aug 26 22:13:25 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:13:25 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:13:25 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:13:25 user nova-compute[72929]:     </memballoon>
Aug 26 22:13:25 user nova-compute[72929]:   </devices>
Aug 26 22:13:25 user nova-compute[72929]: </domain>
Aug 26 22:13:25 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1878679145',display_name='tempest-AttachVolumeTestJSON-server-1878679145',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1878679145',id=32,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM0CrzBlXYupSIF/nDamqPetdUmLnaTt2IZkXMQjS/EZUIFDu8cWKIhC9sD8wwpdsEB/3lE8LgbT08dncrwIUKA5rs+grEEX2NW73CO2NjT0a7WTwa0cAXPrU4LkRibPw==',key_name='tempest-keypair-1850158011',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-rn93lam8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:13:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=7f3b60d4-d395-4859-9109-c2e052aebdb9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG os_vif [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d0c2da8-01, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d0c2da8-01, col_values=(('external_ids', {'iface-id': '2d0c2da8-0185-47cf-970c-54f99f3d63e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:97:51', 'vm-uuid': '7f3b60d4-d395-4859-9109-c2e052aebdb9'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:25 user nova-compute[72929]: INFO os_vif [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01')
Aug 26 22:13:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:13:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No VIF found with MAC fa:16:3e:7a:97:51, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updated VIF entry in instance network info cache for port 2d0c2da8-0185-47cf-970c-54f99f3d63e9. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updating instance_info_cache with network_info: [{"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a5616a4c-4f4d-42b5-8a18-1c480d8cd139 req-3cb1be65-f655-46f4-b7b8-bd58b19f2e51 service nova] Releasing lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk.rescue --force-share --output=json" returned: 0 in 0.332s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-f2180f55-5c30-41af-ba77-0bf180bd5b31 req-eca00963-9b1b-4ba0-9e90-eb402235606d service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f2180f55-5c30-41af-ba77-0bf180bd5b31 req-eca00963-9b1b-4ba0-9e90-eb402235606d service nova] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f2180f55-5c30-41af-ba77-0bf180bd5b31 req-eca00963-9b1b-4ba0-9e90-eb402235606d service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f2180f55-5c30-41af-ba77-0bf180bd5b31 req-eca00963-9b1b-4ba0-9e90-eb402235606d service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-f2180f55-5c30-41af-ba77-0bf180bd5b31 req-eca00963-9b1b-4ba0-9e90-eb402235606d service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] No waiting events found dispatching network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:27 user nova-compute[72929]: WARNING nova.compute.manager [req-f2180f55-5c30-41af-ba77-0bf180bd5b31 req-eca00963-9b1b-4ba0-9e90-eb402235606d service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received unexpected event network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 for instance with vm_state building and task_state spawning.
Aug 26 22:13:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:29 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:29 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7956MB free_disk=23.20644760131836GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-dd6db322-faad-499c-a9cb-9861e46fcac0 req-f33792a1-60d9-45fd-93cb-243fda8c27bd service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dd6db322-faad-499c-a9cb-9861e46fcac0 req-f33792a1-60d9-45fd-93cb-243fda8c27bd service nova] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dd6db322-faad-499c-a9cb-9861e46fcac0 req-f33792a1-60d9-45fd-93cb-243fda8c27bd service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dd6db322-faad-499c-a9cb-9861e46fcac0 req-f33792a1-60d9-45fd-93cb-243fda8c27bd service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-dd6db322-faad-499c-a9cb-9861e46fcac0 req-f33792a1-60d9-45fd-93cb-243fda8c27bd service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] No waiting events found dispatching network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:29 user nova-compute[72929]: WARNING nova.compute.manager [req-dd6db322-faad-499c-a9cb-9861e46fcac0 req-f33792a1-60d9-45fd-93cb-243fda8c27bd service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received unexpected event network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 for instance with vm_state building and task_state spawning.
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088010.008472, 7f3b60d4-d395-4859-9109-c2e052aebdb9 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] VM Resumed (Lifecycle Event)
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Instance spawned successfully.
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088010.013907, 7f3b60d4-d395-4859-9109-c2e052aebdb9 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] VM Started (Lifecycle Event)
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2f582511-ae2c-47e3-aa26-86e173891e56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Took 7.44 seconds to spawn the instance on the hypervisor.
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:13:30 user nova-compute[72929]: INFO nova.compute.manager [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Took 8.53 seconds to build instance.
Aug 26 22:13:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d3092c82-576f-4845-b1f3-2988a3907e82 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.687s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:13:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:13:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:32 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [{"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-e17322c4-5841-452d-b4f1-f67f85a9827a" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:37 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:13:37 user nova-compute[72929]: INFO nova.compute.claims [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Claim successful on node user
Aug 26 22:13:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:13:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.policy [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc2833663e85431fa3433a128520c8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc89a603c20492d9a2f41085f0e10f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:13:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Creating image(s)
Aug 26 22:13:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.270s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.216s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk 1073741824" returned: 0 in 0.076s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.283s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Cannot resize image /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Ensure instance console log exists: /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:13:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:13:40 user nova-compute[72929]: DEBUG nova.network.neutron [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Successfully created port: d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:13:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Successfully updated port: d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG nova.compute.manager [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-changed-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG nova.compute.manager [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Refreshing instance network info cache due to event network-changed-d89228c0-216f-4eba-a8b3-470f5aca003a. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] Acquiring lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:13:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.network.neutron [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Instance network_info: |[{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] Acquired lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Refreshing network info cache for port d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Start _get_guest_xml network_info=[{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:13:42 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:42 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1551348386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1551348386',id=33,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-gb82att6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:13:39Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=f7399401-da4d-484f-ab62-7cc07d8ab8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'pci_devices' on Instance uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:13:42 user nova-compute[72929]:   <uuid>f7399401-da4d-484f-ab62-7cc07d8ab8a4</uuid>
Aug 26 22:13:42 user nova-compute[72929]:   <name>instance-00000021</name>
Aug 26 22:13:42 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:13:42 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:13:42 user nova-compute[72929]:   <metadata>
Aug 26 22:13:42 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:13:42 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:13:42 user nova-compute[72929]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1551348386</nova:name>
Aug 26 22:13:42 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:13:42</nova:creationTime>
Aug 26 22:13:42 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:13:42 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:13:42 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:13:42 user nova-compute[72929]:       <nova:owner>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:user uuid="cc2833663e85431fa3433a128520c8a8">tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member</nova:user>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:project uuid="dcc89a603c20492d9a2f41085f0e10f5">tempest-ServerBootFromVolumeStableRescueTest-650830425</nova:project>
Aug 26 22:13:42 user nova-compute[72929]:       </nova:owner>
Aug 26 22:13:42 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:13:42 user nova-compute[72929]:       <nova:ports>
Aug 26 22:13:42 user nova-compute[72929]:         <nova:port uuid="d89228c0-216f-4eba-a8b3-470f5aca003a">
Aug 26 22:13:42 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:13:42 user nova-compute[72929]:         </nova:port>
Aug 26 22:13:42 user nova-compute[72929]:       </nova:ports>
Aug 26 22:13:42 user nova-compute[72929]:     </nova:instance>
Aug 26 22:13:42 user nova-compute[72929]:   </metadata>
Aug 26 22:13:42 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:13:42 user nova-compute[72929]:     <system>
Aug 26 22:13:42 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:13:42 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:13:42 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:13:42 user nova-compute[72929]:       <entry name="serial">f7399401-da4d-484f-ab62-7cc07d8ab8a4</entry>
Aug 26 22:13:42 user nova-compute[72929]:       <entry name="uuid">f7399401-da4d-484f-ab62-7cc07d8ab8a4</entry>
Aug 26 22:13:42 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:13:42 user nova-compute[72929]:     </system>
Aug 26 22:13:42 user nova-compute[72929]:   </sysinfo>
Aug 26 22:13:42 user nova-compute[72929]:   <os>
Aug 26 22:13:42 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:13:42 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:13:42 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:13:42 user nova-compute[72929]:   </os>
Aug 26 22:13:42 user nova-compute[72929]:   <features>
Aug 26 22:13:42 user nova-compute[72929]:     <acpi/>
Aug 26 22:13:42 user nova-compute[72929]:     <apic/>
Aug 26 22:13:42 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:13:42 user nova-compute[72929]:   </features>
Aug 26 22:13:42 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:13:42 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:13:42 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:13:42 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:13:42 user nova-compute[72929]:   </clock>
Aug 26 22:13:42 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:13:42 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:13:42 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:13:42 user nova-compute[72929]:   </cpu>
Aug 26 22:13:42 user nova-compute[72929]:   <devices>
Aug 26 22:13:42 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:13:42 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:13:42 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk"/>
Aug 26 22:13:42 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:13:42 user nova-compute[72929]:     </disk>
Aug 26 22:13:42 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:13:42 user nova-compute[72929]:       <mac address="fa:16:3e:22:42:e2"/>
Aug 26 22:13:42 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:13:42 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:13:42 user nova-compute[72929]:       <target dev="tapd89228c0-21"/>
Aug 26 22:13:42 user nova-compute[72929]:     </interface>
Aug 26 22:13:42 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:13:42 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/console.log" append="off"/>
Aug 26 22:13:42 user nova-compute[72929]:     </serial>
Aug 26 22:13:42 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:13:42 user nova-compute[72929]:     <video>
Aug 26 22:13:42 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:13:42 user nova-compute[72929]:     </video>
Aug 26 22:13:42 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:13:42 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:13:42 user nova-compute[72929]:     </rng>
Aug 26 22:13:42 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:13:42 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:13:42 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:13:42 user nova-compute[72929]:     </memballoon>
Aug 26 22:13:42 user nova-compute[72929]:   </devices>
Aug 26 22:13:42 user nova-compute[72929]: </domain>
Aug 26 22:13:42 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1551348386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1551348386',id=33,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-gb82att6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:13:39Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=f7399401-da4d-484f-ab62-7cc07d8ab8a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG os_vif [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd89228c0-21, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd89228c0-21, col_values=(('external_ids', {'iface-id': 'd89228c0-216f-4eba-a8b3-470f5aca003a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:42:e2', 'vm-uuid': 'f7399401-da4d-484f-ab62-7cc07d8ab8a4'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:42 user nova-compute[72929]: INFO os_vif [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21')
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:13:42 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No VIF found with MAC fa:16:3e:22:42:e2, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:13:43 user nova-compute[72929]: DEBUG nova.network.neutron [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updated VIF entry in instance network info cache for port d89228c0-216f-4eba-a8b3-470f5aca003a. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:13:43 user nova-compute[72929]: DEBUG nova.network.neutron [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:13:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-dcf17ae6-27c9-461c-95d1-aed08178652a req-fdafef48-66a9-4324-81fb-368ce7680182 service nova] Releasing lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:13:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-94ad9044-7bdd-47ee-8491-25cf6c8609a8 req-bf52e340-c427-4575-810c-2d9f5f5ad26a service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-94ad9044-7bdd-47ee-8491-25cf6c8609a8 req-bf52e340-c427-4575-810c-2d9f5f5ad26a service nova] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-94ad9044-7bdd-47ee-8491-25cf6c8609a8 req-bf52e340-c427-4575-810c-2d9f5f5ad26a service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-94ad9044-7bdd-47ee-8491-25cf6c8609a8 req-bf52e340-c427-4575-810c-2d9f5f5ad26a service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-94ad9044-7bdd-47ee-8491-25cf6c8609a8 req-bf52e340-c427-4575-810c-2d9f5f5ad26a service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] No waiting events found dispatching network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:45 user nova-compute[72929]: WARNING nova.compute.manager [req-94ad9044-7bdd-47ee-8491-25cf6c8609a8 req-bf52e340-c427-4575-810c-2d9f5f5ad26a service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received unexpected event network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a for instance with vm_state building and task_state spawning.
Aug 26 22:13:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_power_states {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid c1608933-05ed-4314-a13b-a48035aa841b {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "c1608933-05ed-4314-a13b-a48035aa841b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "c1608933-05ed-4314-a13b-a48035aa841b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-23e7e028-6117-4115-b31d-670b44792156 req-51d6c6a3-9a2f-4e92-99e2-2185f3c2e5ee service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23e7e028-6117-4115-b31d-670b44792156 req-51d6c6a3-9a2f-4e92-99e2-2185f3c2e5ee service nova] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23e7e028-6117-4115-b31d-670b44792156 req-51d6c6a3-9a2f-4e92-99e2-2185f3c2e5ee service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23e7e028-6117-4115-b31d-670b44792156 req-51d6c6a3-9a2f-4e92-99e2-2185f3c2e5ee service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-23e7e028-6117-4115-b31d-670b44792156 req-51d6c6a3-9a2f-4e92-99e2-2185f3c2e5ee service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] No waiting events found dispatching network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:47 user nova-compute[72929]: WARNING nova.compute.manager [req-23e7e028-6117-4115-b31d-670b44792156 req-51d6c6a3-9a2f-4e92-99e2-2185f3c2e5ee service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received unexpected event network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a for instance with vm_state building and task_state spawning.
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088027.1809413, f7399401-da4d-484f-ab62-7cc07d8ab8a4 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] VM Resumed (Lifecycle Event)
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Instance spawned successfully.
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088027.1857262, f7399401-da4d-484f-ab62-7cc07d8ab8a4 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] VM Started (Lifecycle Event)
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Took 8.68 seconds to spawn the instance on the hypervisor.
Aug 26 22:13:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Took 9.69 seconds to build instance.
Aug 26 22:13:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-31d65b74-c826-4045-b106-b17bc948d07c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.825s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.046s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:47 user nova-compute[72929]: INFO nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:13:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:52 user nova-compute[72929]: INFO nova.compute.manager [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Terminating instance
Aug 26 22:13:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a053c62-e063-4cf5-ba2d-c7f1f61f0d3d req-48dd25a3-e412-43a9-bbd7-4960d45da2c5 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-unplugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a053c62-e063-4cf5-ba2d-c7f1f61f0d3d req-48dd25a3-e412-43a9-bbd7-4960d45da2c5 service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a053c62-e063-4cf5-ba2d-c7f1f61f0d3d req-48dd25a3-e412-43a9-bbd7-4960d45da2c5 service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a053c62-e063-4cf5-ba2d-c7f1f61f0d3d req-48dd25a3-e412-43a9-bbd7-4960d45da2c5 service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a053c62-e063-4cf5-ba2d-c7f1f61f0d3d req-48dd25a3-e412-43a9-bbd7-4960d45da2c5 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-unplugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a053c62-e063-4cf5-ba2d-c7f1f61f0d3d req-48dd25a3-e412-43a9-bbd7-4960d45da2c5 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-unplugged-6445469e-029a-41c3-8079-da27e416b226 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:13:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Instance destroyed successfully.
Aug 26 22:13:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'resources' on Instance uuid 2f582511-ae2c-47e3-aa26-86e173891e56 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-284762778',display_name='tempest-ServerRescueNegativeTestJSON-server-284762778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-284762778',id=3,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T21:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-ncm66cmc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T21:59:23Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=2f582511-ae2c-47e3-aa26-86e173891e56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "6445469e-029a-41c3-8079-da27e416b226", "address": "fa:16:3e:38:70:ac", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6445469e-02", "ovs_interfaceid": "6445469e-029a-41c3-8079-da27e416b226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG os_vif [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6445469e-02, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:13:53 user nova-compute[72929]: INFO os_vif [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:70:ac,bridge_name='br-int',has_traffic_filtering=True,id=6445469e-029a-41c3-8079-da27e416b226,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6445469e-02')
Aug 26 22:13:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Deleting instance files /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56_del
Aug 26 22:13:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Deletion of /opt/stack/data/nova/instances/2f582511-ae2c-47e3-aa26-86e173891e56_del complete
Aug 26 22:13:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 26 22:13:53 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:13:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:54 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:13:54 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Took 1.55 seconds to deallocate network for instance.
Aug 26 22:13:54 user nova-compute[72929]: DEBUG nova.compute.manager [req-332082c9-0edd-43ac-b0ac-89582539a291 req-66d49491-8d96-415f-9b09-f38bff9f4386 service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-deleted-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-86c8a02e-1480-40cf-bab0-5df6d8ab8b27 req-3a74c18c-9c8e-4111-9083-e74af6a1581b service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-86c8a02e-1480-40cf-bab0-5df6d8ab8b27 req-3a74c18c-9c8e-4111-9083-e74af6a1581b service nova] Acquiring lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-86c8a02e-1480-40cf-bab0-5df6d8ab8b27 req-3a74c18c-9c8e-4111-9083-e74af6a1581b service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-86c8a02e-1480-40cf-bab0-5df6d8ab8b27 req-3a74c18c-9c8e-4111-9083-e74af6a1581b service nova] Lock "2f582511-ae2c-47e3-aa26-86e173891e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-86c8a02e-1480-40cf-bab0-5df6d8ab8b27 req-3a74c18c-9c8e-4111-9083-e74af6a1581b service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] No waiting events found dispatching network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:13:55 user nova-compute[72929]: WARNING nova.compute.manager [req-86c8a02e-1480-40cf-bab0-5df6d8ab8b27 req-3a74c18c-9c8e-4111-9083-e74af6a1581b service nova] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Received unexpected event network-vif-plugged-6445469e-029a-41c3-8079-da27e416b226 for instance with vm_state deleted and task_state None.
Aug 26 22:13:55 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:13:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:55 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Deleted allocations for instance 2f582511-ae2c-47e3-aa26-86e173891e56
Aug 26 22:13:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5460d101-d3cd-4181-809f-c0336f8d5ee4 tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "2f582511-ae2c-47e3-aa26-86e173891e56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.529s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:13:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:13:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:03 user nova-compute[72929]: INFO nova.compute.manager [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Unrescuing
Aug 26 22:14:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:03 user nova-compute[72929]: DEBUG nova.network.neutron [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:04 user nova-compute[72929]: INFO nova.compute.manager [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Terminating instance
Aug 26 22:14:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG nova.network.neutron [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG nova.objects.instance [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'flavor' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a588711-52d5-45cd-9e49-64190a0b533e req-81bb5414-6647-4616-9900-ebdec8cd1efe service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-vif-unplugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a588711-52d5-45cd-9e49-64190a0b533e req-81bb5414-6647-4616-9900-ebdec8cd1efe service nova] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a588711-52d5-45cd-9e49-64190a0b533e req-81bb5414-6647-4616-9900-ebdec8cd1efe service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a588711-52d5-45cd-9e49-64190a0b533e req-81bb5414-6647-4616-9900-ebdec8cd1efe service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a588711-52d5-45cd-9e49-64190a0b533e req-81bb5414-6647-4616-9900-ebdec8cd1efe service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] No waiting events found dispatching network-vif-unplugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a588711-52d5-45cd-9e49-64190a0b533e req-81bb5414-6647-4616-9900-ebdec8cd1efe service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-vif-unplugged-86ee989f-5505-4562-bd79-24f1d5489e44 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance destroyed successfully.
Aug 26 22:14:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Instance destroyed successfully.
Aug 26 22:14:05 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lazy-loading 'resources' on Instance uuid bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2051082546',display_name='tempest-ServersNegativeTestJSON-server-2051082546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2051082546',id=22,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60c177bf6e804c3292dab6eaf860934d',ramdisk_id='',reservation_id='r-99088i6v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-789296540',owner_user_name='tempest-ServersNegativeTestJSON-789296540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:05:07Z,user_data=None,user_id='9c667638141d429e925ecd38af6423fc',uuid=bc831d2d-9dae-4c2a-8514-eb8eb782e3e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converting VIF {"id": "86ee989f-5505-4562-bd79-24f1d5489e44", "address": "fa:16:3e:fa:5e:d8", "network": {"id": "76691182-3f65-4061-bc3f-e10f973e4be2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-872261956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60c177bf6e804c3292dab6eaf860934d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ee989f-55", "ovs_interfaceid": "86ee989f-5505-4562-bd79-24f1d5489e44", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG os_vif [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86ee989f-55, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:05 user nova-compute[72929]: INFO os_vif [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:5e:d8,bridge_name='br-int',has_traffic_filtering=True,id=86ee989f-5505-4562-bd79-24f1d5489e44,network=Network(76691182-3f65-4061-bc3f-e10f973e4be2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ee989f-55')
Aug 26 22:14:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Deleting instance files /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8_del
Aug 26 22:14:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Deletion of /opt/stack/data/nova/instances/bc831d2d-9dae-4c2a-8514-eb8eb782e3e8_del complete
Aug 26 22:14:05 user nova-compute[72929]: INFO nova.compute.manager [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Took 1.51 seconds to destroy the instance on the hypervisor.
Aug 26 22:14:05 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:14:05 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing instance network info cache due to event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updated VIF entry in instance network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d45fd756-9e41-43a9-a9d6-5c91ec6043ea req-0732cc6a-db5e-4675-88b0-addcfc607ada service nova] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Acquiring lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] No waiting events found dispatching network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:07 user nova-compute[72929]: WARNING nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received unexpected event network-vif-plugged-86ee989f-5505-4562-bd79-24f1d5489e44 for instance with vm_state active and task_state deleting.
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:07 user nova-compute[72929]: WARNING nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:07 user nova-compute[72929]: WARNING nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:07 user nova-compute[72929]: WARNING nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:07 user nova-compute[72929]: WARNING nova.compute.manager [req-a4d17211-4304-4ae9-923b-92ee33022b38 req-31e7a140-1253-4a1d-9509-8fc93eb7b54a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:07 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Took 1.39 seconds to deallocate network for instance.
Aug 26 22:14:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Deleted allocations for instance bc831d2d-9dae-4c2a-8514-eb8eb782e3e8
Aug 26 22:14:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9859fe7e-eca2-47fb-92a9-2958644f3e1d tempest-ServersNegativeTestJSON-789296540 tempest-ServersNegativeTestJSON-789296540-project-member] Lock "bc831d2d-9dae-4c2a-8514-eb8eb782e3e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.511s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088033.0766883, 2f582511-ae2c-47e3-aa26-86e173891e56 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:08 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] VM Stopped (Lifecycle Event)
Aug 26 22:14:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4dbacd5f-9314-42f7-bf97-59ea7bb0d8a9 None None] [instance: 2f582511-ae2c-47e3-aa26-86e173891e56] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing instance network info cache due to event network-changed-36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] Acquiring lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] Acquired lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Refreshing network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Received event network-vif-deleted-86ee989f-5505-4562-bd79-24f1d5489e44 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:09 user nova-compute[72929]: WARNING nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:09 user nova-compute[72929]: WARNING nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:09 user nova-compute[72929]: WARNING nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:09 user nova-compute[72929]: WARNING nova.compute.manager [req-3286e995-8124-4c03-b25d-4e098d291545 req-9b21dab3-fd2e-44b0-95de-87ec897467b9 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updated VIF entry in instance network info cache for port 36a6c019-2580-4d4b-8223-6ec70a6c0046. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [{"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3b3f8a1f-37cf-439b-a6a8-230af3706e5f req-1fbbcd07-a95a-4ee0-9085-5d42d5bcec4a service nova] Releasing lock "refresh_cache-51939e0e-26e5-4a6c-9f85-a294036fd456" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-59f33f7a-c3cf-40be-8c0f-7928e308b432 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 51939e0e-26e5-4a6c-9f85-a294036fd456 due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088049.675115, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Resumed (Lifecycle Event)
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:14:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088049.6755235, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Started (Lifecycle Event)
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:14:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:20 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088045.5267756, bc831d2d-9dae-4c2a-8514-eb8eb782e3e8 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:20 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] VM Stopped (Lifecycle Event)
Aug 26 22:14:20 user nova-compute[72929]: DEBUG nova.compute.manager [None req-96ad823b-2361-4cf7-97da-8e79f226205e None None] [instance: bc831d2d-9dae-4c2a-8514-eb8eb782e3e8] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-changed-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Refreshing instance network info cache due to event network-changed-8c43ee94-0853-4850-95f1-3f889602ec01. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG nova.network.neutron [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Refreshing network info cache for port 8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG nova.network.neutron [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updated VIF entry in instance network info cache for port 8c43ee94-0853-4850-95f1-3f889602ec01. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG nova.network.neutron [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a85f9982-9caf-4a6a-831e-84886df3c62f req-ddc54047-bdfc-4c51-a1ba-25a13feeb5f2 service nova] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-changed-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Refreshing instance network info cache due to event network-changed-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.network.neutron [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Refreshing network info cache for port 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.compute.manager [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Stashing vm_state: active {{(pid=72929) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:14:27 user nova-compute[72929]: INFO nova.compute.claims [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Claim successful on node user
Aug 26 22:14:27 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating resource usage from migration 16de4c7f-def2-4652-aad1-fba256cbc428
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:14:27 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG nova.network.neutron [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updated VIF entry in instance network info cache for port 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG nova.network.neutron [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2895ea4b-9532-4fda-b13c-249d8fcfd76f req-e7f60fba-95d2-42b8-a574-c63421833494 service nova] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.533s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:28 user nova-compute[72929]: INFO nova.compute.manager [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Migrating
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:29 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:14:29 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=24.18924331665039GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Starting migrate_disk_and_power_off {{(pid=72929) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Applying migration context for instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 as it has an incoming, in-progress migration 16de4c7f-def2-4652-aad1-fba256cbc428. Migration status is migrating {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 22:14:29 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating resource usage from migration 16de4c7f-def2-4652-aad1-fba256cbc428
Aug 26 22:14:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance e17322c4-5841-452d-b4f1-f67f85a9827a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Migration 16de4c7f-def2-4652-aad1-fba256cbc428 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-44191f89-d68f-46c8-902b-964c2be8b8ea req-8cb3c2a5-78f2-4b68-a52f-746643ae25a6 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-unplugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-44191f89-d68f-46c8-902b-964c2be8b8ea req-8cb3c2a5-78f2-4b68-a52f-746643ae25a6 service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-44191f89-d68f-46c8-902b-964c2be8b8ea req-8cb3c2a5-78f2-4b68-a52f-746643ae25a6 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-44191f89-d68f-46c8-902b-964c2be8b8ea req-8cb3c2a5-78f2-4b68-a52f-746643ae25a6 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-44191f89-d68f-46c8-902b-964c2be8b8ea req-8cb3c2a5-78f2-4b68-a52f-746643ae25a6 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-unplugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:29 user nova-compute[72929]: WARNING nova.compute.manager [req-44191f89-d68f-46c8-902b-964c2be8b8ea req-8cb3c2a5-78f2-4b68-a52f-746643ae25a6 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-unplugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state active and task_state resize_migrating.
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:14:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:30 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance destroyed successfully.
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038925650',display_name='tempest-ServerActionsTestOtherA-server-2038925650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2038925650',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-2r1jp5t6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=21b46025-5ff1-4bf1-a9a0-fd7a1549c705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08c2128c-77, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:14:30 user nova-compute[72929]: INFO os_vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77')
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:14:30 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac9d15-253e-423b-aa9d-daceb385c106]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e772017-96d3-4ae9-882a-e45dc0b05f27]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:14:30 user nova-compute[72929]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:14:30 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:14:30 user nova-compute[72929]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:14:30 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b60703130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9565734-f57b-4166-a169-2d9d44c4ffaa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[39528f85-6347-423a-800b-b0a6f0f1fc14]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e5f17-d923-457a-aa80-b1d94933bc6f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa34c2-0a82-4719-8ecc-1e0756658fbf]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23031643036313632', '/dev/disk/by-id/scsi-1SCST_BIO56aebb8e-01d06162d3c12810', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_56aebb8e') {{(pid=84150) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e417b-e562-4fb8-94d8-ee39fe71ac64]: (4, None) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa63ba3-d57f-46d3-9d1c-ef7f98ade451]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f377a0-16d2-4678-9ad1-5e6a8a27378a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]
Aug 26 22:14:30 user nova-compute[72929]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.
Aug 26 22:14:30 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3dbdcc-3d54-413b-810b-9c1ec61b74a9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== disconnect_volume: return (326ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-f6cd68ca-14b2-4db9-a613-222558848e1f req-1358fa37-0ce4-4583-9160-7a1bcc381e18 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f6cd68ca-14b2-4db9-a613-222558848e1f req-1358fa37-0ce4-4583-9160-7a1bcc381e18 service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f6cd68ca-14b2-4db9-a613-222558848e1f req-1358fa37-0ce4-4583-9160-7a1bcc381e18 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f6cd68ca-14b2-4db9-a613-222558848e1f req-1358fa37-0ce4-4583-9160-7a1bcc381e18 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-f6cd68ca-14b2-4db9-a613-222558848e1f req-1358fa37-0ce4-4583-9160-7a1bcc381e18 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:31 user nova-compute[72929]: WARNING nova.compute.manager [req-f6cd68ca-14b2-4db9-a613-222558848e1f req-1358fa37-0ce4-4583-9160-7a1bcc381e18 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state active and task_state resize_migrating.
Aug 26 22:14:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Port 08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 binding to destination host user is already ACTIVE {{(pid=72929) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG os_brick.utils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e85d458-75ee-4ba1-b536-88ab9391acc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ae9e53-d4e8-46d2-beab-a2c579c1667b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd7c191-ca7e-4862-b5c6-38028efe299f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[836fb495-de02-4175-90af-04f10d300390]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:14:34 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:14:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4586af23-8074-419c-a2a9-9afb2435cd69]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:14:34 user nova-compute[72929]: DEBUG os_brick.utils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:14:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:37 user nova-compute[72929]: INFO nova.compute.manager [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Detaching volume 5bc42200-a2d1-4e83-932f-08e9011e8acf
Aug 26 22:14:37 user nova-compute[72929]: INFO nova.virt.block_device [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Attempting to driver detach volume 5bc42200-a2d1-4e83-932f-08e9011e8acf from mountpoint /dev/vdb
Aug 26 22:14:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Attempting to detach device vdb from instance 51939e0e-26e5-4a6c-9f85-a294036fd456 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:14:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:14:37 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:14:37 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:14:37 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:14:37 user nova-compute[72929]:   <serial>5bc42200-a2d1-4e83-932f-08e9011e8acf</serial>
Aug 26 22:14:37 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:14:37 user nova-compute[72929]: </disk>
Aug 26 22:14:37 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:14:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Successfully detached device vdb from instance 51939e0e-26e5-4a6c-9f85-a294036fd456 from the persistent domain config.
Aug 26 22:14:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 51939e0e-26e5-4a6c-9f85-a294036fd456 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:14:38 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:14:38 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:14:38 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:14:38 user nova-compute[72929]:   <serial>5bc42200-a2d1-4e83-932f-08e9011e8acf</serial>
Aug 26 22:14:38 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:14:38 user nova-compute[72929]: </disk>
Aug 26 22:14:38 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088078.5071049, 51939e0e-26e5-4a6c-9f85-a294036fd456 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:14:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Successfully detached device vdb from instance 51939e0e-26e5-4a6c-9f85-a294036fd456 from the live domain config.
Aug 26 22:14:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eETAJWhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:14:38 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d140ad3-f445-4306-8a70-677459ea83e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe22dc78-8680-4dad-8567-2300b1b56d90]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:14:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf (non-flash)
Aug 26 22:14:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b80795870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8a060-171a-4be8-aedf-551c213a9392]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44c4b45-0cbf-4d46-8bbe-c6f0de8bfeb3]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd84f3f-98f7-447d-85d3-a69d709ba90c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c56ed0-241a-4651-b407-20ad0ca8ae50]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d489f0-9a92-4798-8a59-fd4e55f199d3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c15c29b-2480-4b0d-9267-94c7932877fc]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260]
Aug 26 22:14:38 user nova-compute[72929]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf, portal: 172.16.0.220,3260] successful.
Aug 26 22:14:38 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bc42200-a2d1-4e83-932f-08e9011e8acf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6001ae-5ac9-43d1-9793-bb1c5de31d3d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] <== disconnect_volume: return (302ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:14:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:14:39 user nova-compute[72929]: DEBUG nova.objects.instance [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'flavor' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:14:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ccb75179-95ec-4d86-b59d-9ba8be40d560 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.872s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:42 user nova-compute[72929]: INFO nova.compute.manager [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Terminating instance
Aug 26 22:14:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-e21782be-7d86-46c8-a29f-79b41245a7a3 req-64fd484a-707c-46b1-8a4d-9517ea92e9ea service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e21782be-7d86-46c8-a29f-79b41245a7a3 req-64fd484a-707c-46b1-8a4d-9517ea92e9ea service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e21782be-7d86-46c8-a29f-79b41245a7a3 req-64fd484a-707c-46b1-8a4d-9517ea92e9ea service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e21782be-7d86-46c8-a29f-79b41245a7a3 req-64fd484a-707c-46b1-8a4d-9517ea92e9ea service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-e21782be-7d86-46c8-a29f-79b41245a7a3 req-64fd484a-707c-46b1-8a4d-9517ea92e9ea service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-e21782be-7d86-46c8-a29f-79b41245a7a3 req-64fd484a-707c-46b1-8a4d-9517ea92e9ea service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-unplugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:14:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Instance destroyed successfully.
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lazy-loading 'resources' on Instance uuid e17322c4-5841-452d-b4f1-f67f85a9827a {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T21:57:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-99622531',display_name='tempest-ServerRescueNegativeTestJSON-server-99622531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-99622531',id=1,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:02:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6d14fc09c246779e46e7c816370a1c',ramdisk_id='',reservation_id='r-cdrtnr48',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-26026282',owner_user_name='tempest-ServerRescueNegativeTestJSON-26026282-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:04:08Z,user_data=None,user_id='6c2dac68027a44a09a4deadab28f2981',uuid=e17322c4-5841-452d-b4f1-f67f85a9827a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converting VIF {"id": "d4498661-cc5a-4569-8826-1dec471eda12", "address": "fa:16:3e:2c:9a:a6", "network": {"id": "dd332334-6ed7-472c-b81f-389c876cb126", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1229472204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6d14fc09c246779e46e7c816370a1c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4498661-cc", "ovs_interfaceid": "d4498661-cc5a-4569-8826-1dec471eda12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG os_vif [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4498661-cc, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:14:43 user nova-compute[72929]: INFO os_vif [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:9a:a6,bridge_name='br-int',has_traffic_filtering=True,id=d4498661-cc5a-4569-8826-1dec471eda12,network=Network(dd332334-6ed7-472c-b81f-389c876cb126),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4498661-cc')
Aug 26 22:14:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Deleting instance files /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a_del
Aug 26 22:14:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Deletion of /opt/stack/data/nova/instances/e17322c4-5841-452d-b4f1-f67f85a9827a_del complete
Aug 26 22:14:43 user nova-compute[72929]: INFO nova.compute.manager [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Took 0.82 seconds to destroy the instance on the hypervisor.
Aug 26 22:14:43 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:14:43 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:14:44 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:14:44 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Took 0.53 seconds to deallocate network for instance.
Aug 26 22:14:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:44 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:14:44 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:14:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:44 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Deleted allocations for instance e17322c4-5841-452d-b4f1-f67f85a9827a
Aug 26 22:14:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6d5f6a9a-7637-4060-9a66-7e572c0a908e tempest-ServerRescueNegativeTestJSON-26026282 tempest-ServerRescueNegativeTestJSON-26026282-project-member] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:45 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088070.0097103, 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:45 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] VM Stopped (Lifecycle Event)
Aug 26 22:14:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3fbb2614-c9a1-4936-817e-6735bc852ee3 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3fbb2614-c9a1-4936-817e-6735bc852ee3 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:14:45 user nova-compute[72929]: INFO nova.compute.manager [None req-3fbb2614-c9a1-4936-817e-6735bc852ee3 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 22:14:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] Acquiring lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] Lock "e17322c4-5841-452d-b4f1-f67f85a9827a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] No waiting events found dispatching network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:45 user nova-compute[72929]: WARNING nova.compute.manager [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received unexpected event network-vif-plugged-d4498661-cc5a-4569-8826-1dec471eda12 for instance with vm_state deleted and task_state None.
Aug 26 22:14:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdf4c1be-594e-4c67-a3ab-f3c8016019a4 req-5666a4a1-7011-46d5-83be-7627312354c0 service nova] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Received event network-vif-deleted-d4498661-cc5a-4569-8826-1dec471eda12 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Starting finish_migration {{(pid=72929) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:14:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Creating image(s)
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Ensure instance console log exists: /opt/stack/data/nova/instances/21b46025-5ff1-4bf1-a9a0-fd7a1549c705/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Start _get_guest_xml network_info=[{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'b56d9be1-dae8-42c0-b894-b13248eabac7', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '21b46025-5ff1-4bf1-a9a0-fd7a1549c705', 'attached_at': '2023-08-26T22:14:50.000000', 'detached_at': '', 'volume_id': '48e33df3-6b1c-4ce7-bca3-476fa6ce97b4', 'serial': '48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:14:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:14:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:29Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:14:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:14:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:14:50 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[01648533-8ed9-4b56-bbda-130f4f748269]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:14:50 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9189e279-86d3-4ed8-be93-ba61fd1edd96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4] added
Aug 26 22:14:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c6a511-1200-4a28-80de-3242f22b33f2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00292bb-c066-4946-a680-952689bafccf]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCwhWQld {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCwhWQld" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ddfe3-a0dd-480c-8fee-c53f6a7b8f5c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCwhWQld'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[44741cb6-0160-421f-a253-dc86266dcc3f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfce9d07-15c3-41ee-ac45-928c0f9fb614]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 26 22:14:50 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 26 22:14:50 user nova-compute[72929]:  {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:14:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 26 22:14:50 user nova-compute[72929]: 
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d98ecc5-f92b-4144-8ada-459c6d18ba2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]
Aug 26 22:14:50 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.
Aug 26 22:14:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5c18e6-bd75-43f1-b400-a46be0ab90c9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b0a81-0a05-4ef7-b24a-2ae9796d2900]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:14:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:14:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07491db-f1ed-45fe-a023-22e1eb534daf]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:14:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23031643036313632', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031643036313632', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038925650',display_name='tempest-ServerActionsTestOtherA-server-2038925650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2038925650',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-2r1jp5t6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:14:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=21b46025-5ff1-4bf1-a9a0-fd7a1549c705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:14:51 user nova-compute[72929]:   <uuid>21b46025-5ff1-4bf1-a9a0-fd7a1549c705</uuid>
Aug 26 22:14:51 user nova-compute[72929]:   <name>instance-0000001f</name>
Aug 26 22:14:51 user nova-compute[72929]:   <memory>2097152</memory>
Aug 26 22:14:51 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:14:51 user nova-compute[72929]:   <metadata>
Aug 26 22:14:51 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:14:51 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:14:51 user nova-compute[72929]:       <nova:name>tempest-ServerActionsTestOtherA-server-2038925650</nova:name>
Aug 26 22:14:51 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:14:50</nova:creationTime>
Aug 26 22:14:51 user nova-compute[72929]:       <nova:flavor name="m1.small">
Aug 26 22:14:51 user nova-compute[72929]:         <nova:memory>2048</nova:memory>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:disk>20</nova:disk>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:14:51 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:14:51 user nova-compute[72929]:       <nova:owner>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:user uuid="93c597a2c99646f1bb79645380ce0b75">tempest-ServerActionsTestOtherA-1951554093-project-member</nova:user>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:project uuid="4e6cde0e448142e48abb9220470391f2">tempest-ServerActionsTestOtherA-1951554093</nova:project>
Aug 26 22:14:51 user nova-compute[72929]:       </nova:owner>
Aug 26 22:14:51 user nova-compute[72929]:       <nova:ports>
Aug 26 22:14:51 user nova-compute[72929]:         <nova:port uuid="08c2128c-77ab-47c8-a1a4-5ef5efaee1c2">
Aug 26 22:14:51 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 22:14:51 user nova-compute[72929]:         </nova:port>
Aug 26 22:14:51 user nova-compute[72929]:       </nova:ports>
Aug 26 22:14:51 user nova-compute[72929]:     </nova:instance>
Aug 26 22:14:51 user nova-compute[72929]:   </metadata>
Aug 26 22:14:51 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:14:51 user nova-compute[72929]:     <system>
Aug 26 22:14:51 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:14:51 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:14:51 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:14:51 user nova-compute[72929]:       <entry name="serial">21b46025-5ff1-4bf1-a9a0-fd7a1549c705</entry>
Aug 26 22:14:51 user nova-compute[72929]:       <entry name="uuid">21b46025-5ff1-4bf1-a9a0-fd7a1549c705</entry>
Aug 26 22:14:51 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:14:51 user nova-compute[72929]:     </system>
Aug 26 22:14:51 user nova-compute[72929]:   </sysinfo>
Aug 26 22:14:51 user nova-compute[72929]:   <os>
Aug 26 22:14:51 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:14:51 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:14:51 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:14:51 user nova-compute[72929]:   </os>
Aug 26 22:14:51 user nova-compute[72929]:   <features>
Aug 26 22:14:51 user nova-compute[72929]:     <acpi/>
Aug 26 22:14:51 user nova-compute[72929]:     <apic/>
Aug 26 22:14:51 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:14:51 user nova-compute[72929]:   </features>
Aug 26 22:14:51 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:14:51 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:14:51 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:14:51 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:14:51 user nova-compute[72929]:   </clock>
Aug 26 22:14:51 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:14:51 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:14:51 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:14:51 user nova-compute[72929]:   </cpu>
Aug 26 22:14:51 user nova-compute[72929]:   <devices>
Aug 26 22:14:51 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:14:51 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:14:51 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:14:51 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:14:51 user nova-compute[72929]:       <serial>48e33df3-6b1c-4ce7-bca3-476fa6ce97b4</serial>
Aug 26 22:14:51 user nova-compute[72929]:     </disk>
Aug 26 22:14:51 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:14:51 user nova-compute[72929]:       <mac address="fa:16:3e:7d:05:e6"/>
Aug 26 22:14:51 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:14:51 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:14:51 user nova-compute[72929]:       <target dev="tap08c2128c-77"/>
Aug 26 22:14:51 user nova-compute[72929]:     </interface>
Aug 26 22:14:51 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:14:51 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/21b46025-5ff1-4bf1-a9a0-fd7a1549c705/console.log" append="off"/>
Aug 26 22:14:51 user nova-compute[72929]:     </serial>
Aug 26 22:14:51 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:14:51 user nova-compute[72929]:     <video>
Aug 26 22:14:51 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:14:51 user nova-compute[72929]:     </video>
Aug 26 22:14:51 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:14:51 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:14:51 user nova-compute[72929]:     </rng>
Aug 26 22:14:51 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:14:51 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:14:51 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:14:51 user nova-compute[72929]:     </memballoon>
Aug 26 22:14:51 user nova-compute[72929]:   </devices>
Aug 26 22:14:51 user nova-compute[72929]: </domain>
Aug 26 22:14:51 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038925650',display_name='tempest-ServerActionsTestOtherA-server-2038925650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2038925650',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:13:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-2r1jp5t6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:14:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=21b46025-5ff1-4bf1-a9a0-fd7a1549c705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1870601805-network", "vif_mac": "fa:16:3e:7d:05:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG os_vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08c2128c-77, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08c2128c-77, col_values=(('external_ids', {'iface-id': '08c2128c-77ab-47c8-a1a4-5ef5efaee1c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:05:e6', 'vm-uuid': '21b46025-5ff1-4bf1-a9a0-fd7a1549c705'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:51 user nova-compute[72929]: INFO os_vif [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77')
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:14:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] No VIF found with MAC fa:16:3e:7d:05:e6, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:14:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-93b7ee1a-712c-4963-a51a-e78311d4c21b req-792fdc81-bcc9-4bf4-a9e4-ad67dae551a9 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-93b7ee1a-712c-4963-a51a-e78311d4c21b req-792fdc81-bcc9-4bf4-a9e4-ad67dae551a9 service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-93b7ee1a-712c-4963-a51a-e78311d4c21b req-792fdc81-bcc9-4bf4-a9e4-ad67dae551a9 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-93b7ee1a-712c-4963-a51a-e78311d4c21b req-792fdc81-bcc9-4bf4-a9e4-ad67dae551a9 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-93b7ee1a-712c-4963-a51a-e78311d4c21b req-792fdc81-bcc9-4bf4-a9e4-ad67dae551a9 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:53 user nova-compute[72929]: WARNING nova.compute.manager [req-93b7ee1a-712c-4963-a51a-e78311d4c21b req-792fdc81-bcc9-4bf4-a9e4-ad67dae551a9 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state active and task_state resize_finish.
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088095.1952143, 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] VM Resumed (Lifecycle Event)
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:14:55 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance running successfully.
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Failed to set time: agent not configured {{(pid=72929) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05cf8371-1d1c-47dc-bc48-7e97baf81139 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] finish_migration finished successfully. {{(pid=72929) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:14:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088095.1984463, 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] VM Started (Lifecycle Event)
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:14:55 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-88c96e7b-4ce3-430c-ad5e-34782b4516f8 req-bdc2aef0-39f4-4013-8600-39b8f6328027 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-88c96e7b-4ce3-430c-ad5e-34782b4516f8 req-bdc2aef0-39f4-4013-8600-39b8f6328027 service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-88c96e7b-4ce3-430c-ad5e-34782b4516f8 req-bdc2aef0-39f4-4013-8600-39b8f6328027 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-88c96e7b-4ce3-430c-ad5e-34782b4516f8 req-bdc2aef0-39f4-4013-8600-39b8f6328027 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:14:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-88c96e7b-4ce3-430c-ad5e-34782b4516f8 req-bdc2aef0-39f4-4013-8600-39b8f6328027 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:14:55 user nova-compute[72929]: WARNING nova.compute.manager [req-88c96e7b-4ce3-430c-ad5e-34782b4516f8 req-bdc2aef0-39f4-4013-8600-39b8f6328027 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state active and task_state resize_finish.
Aug 26 22:14:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:58 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088083.4056766, e17322c4-5841-452d-b4f1-f67f85a9827a => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:14:58 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] VM Stopped (Lifecycle Event)
Aug 26 22:14:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2b77d919-e4b6-4602-bafb-53b24408973e None None] [instance: e17322c4-5841-452d-b4f1-f67f85a9827a] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:14:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:14:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:15:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:15:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:15:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:15:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:15:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:15:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:15:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:15:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-changed-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Refreshing instance network info cache due to event network-changed-2d0c2da8-0185-47cf-970c-54f99f3d63e9. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] Acquiring lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] Acquired lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Refreshing network info cache for port 2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updated VIF entry in instance network info cache for port 2d0c2da8-0185-47cf-970c-54f99f3d63e9. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updating instance_info_cache with network_info: [{"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:15:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c4477a5-e7f0-4c00-979a-77d3cd652b0c req-a0a17dab-3b62-46fd-9a7e-eb613e4fc32f service nova] Releasing lock "refresh_cache-7f3b60d4-d395-4859-9109-c2e052aebdb9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:15:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:19 user nova-compute[72929]: INFO nova.compute.manager [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attaching volume 985fac69-2b07-49d2-bb19-86f64c9838d2 to /dev/vdb
Aug 26 22:15:19 user nova-compute[72929]: DEBUG os_brick.utils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5275867-ed62-4835-803f-97ef2144fe90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3193a6-20e9-4426-878f-4c0f0122a877]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8daa5f6-a678-4ad2-9b31-08c601b1866e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2eff163-bdd2-4a0b-8157-4c39d2511c87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:15:19 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:15:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0d55f-9130-442d-84b6-b56dc436e28d]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG os_brick.utils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:15:19 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updating existing volume attachment record: 35c423a3-84a1-4f8c-9a0a-81599df44aa7 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:15:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:28 user nova-compute[72929]: INFO nova.compute.manager [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Terminating instance
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:28 user nova-compute[72929]: INFO nova.compute.manager [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] instance snapshotting
Aug 26 22:15:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Beginning live snapshot process
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-c6a58c13-19c7-499c-bf13-ef7f8d26d699 req-2a9b5b82-6748-4632-b3e9-20dc7f48fe71 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c6a58c13-19c7-499c-bf13-ef7f8d26d699 req-2a9b5b82-6748-4632-b3e9-20dc7f48fe71 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c6a58c13-19c7-499c-bf13-ef7f8d26d699 req-2a9b5b82-6748-4632-b3e9-20dc7f48fe71 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c6a58c13-19c7-499c-bf13-ef7f8d26d699 req-2a9b5b82-6748-4632-b3e9-20dc7f48fe71 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-c6a58c13-19c7-499c-bf13-ef7f8d26d699 req-2a9b5b82-6748-4632-b3e9-20dc7f48fe71 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:15:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-c6a58c13-19c7-499c-bf13-ef7f8d26d699 req-2a9b5b82-6748-4632-b3e9-20dc7f48fe71 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-unplugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.254s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Instance destroyed successfully.
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lazy-loading 'resources' on Instance uuid 51939e0e-26e5-4a6c-9f85-a294036fd456 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-307271181',display_name='tempest-ServerStableDeviceRescueTest-server-307271181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-307271181',id=28,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaQrMpX5D3/D0f5rMRJs05UxwQ4nOPNwd8wSykXIZBFClehKfGl3vJt5kyJy81nVsRMnLuoYuKgJOKXGIqk89oUeud5z/WKozXn+ryW8yrqW1gFfILXb152Y/ToR42/eQ==',key_name='tempest-keypair-994409064',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9b1c93b18e2422783401f0c73fe6390',ramdisk_id='',reservation_id='r-x02l0mvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1771134667',owner_user_name='tempest-ServerStableDeviceRescueTest-1771134667-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:14:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ad44b98452d41a89c4d14747f2a6036',uuid=51939e0e-26e5-4a6c-9f85-a294036fd456,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converting VIF {"id": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "address": "fa:16:3e:8a:10:02", "network": {"id": "bda53e97-8da8-408c-8093-c4bddbbeefff", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-191436951-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9b1c93b18e2422783401f0c73fe6390", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36a6c019-25", "ovs_interfaceid": "36a6c019-2580-4d4b-8223-6ec70a6c0046", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG os_vif [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36a6c019-25, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:15:29 user nova-compute[72929]: INFO os_vif [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:10:02,bridge_name='br-int',has_traffic_filtering=True,id=36a6c019-2580-4d4b-8223-6ec70a6c0046,network=Network(bda53e97-8da8-408c-8093-c4bddbbeefff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36a6c019-25')
Aug 26 22:15:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Deleting instance files /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456_del
Aug 26 22:15:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Deletion of /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456_del complete
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json" returned: 1 in 0.226s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk --force-share --output=json' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:15:29 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001c, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/51939e0e-26e5-4a6c-9f85-a294036fd456/disk
Aug 26 22:15:29 user nova-compute[72929]: INFO nova.compute.manager [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk03qrmnr/9e47802607eb41aea75ae53a107fd7ba.delta 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk03qrmnr/9e47802607eb41aea75ae53a107fd7ba.delta 1073741824" returned: 0 in 0.062s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] Acquiring lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] No waiting events found dispatching network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:15:31 user nova-compute[72929]: WARNING nova.compute.manager [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received unexpected event network-vif-plugged-36a6c019-2580-4d4b-8223-6ec70a6c0046 for instance with vm_state active and task_state deleting.
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Received event network-vif-deleted-36a6c019-2580-4d4b-8223-6ec70a6c0046 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:15:31 user nova-compute[72929]: INFO nova.compute.manager [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Neutron deleted interface 36a6c019-2580-4d4b-8223-6ec70a6c0046; detaching it from the instance and deleting it from the info cache
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.network.neutron [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:15:31 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Took 1.54 seconds to deallocate network for instance.
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:15:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:15:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7981MB free_disk=24.300750732421875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-0cbcc6dc-3876-43e3-8ac4-dc455da667ed req-ae4e318c-a418-43df-9571-74077a1f4af7 service nova] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Detach interface failed, port_id=36a6c019-2580-4d4b-8223-6ec70a6c0046, reason: Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Applying migration context for instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 as it has an incoming, in-progress migration 16de4c7f-def2-4652-aad1-fba256cbc428. Migration status is finished {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 26 22:15:31 user nova-compute[72929]: INFO nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating resource usage from migration 16de4c7f-def2-4652-aad1-fba256cbc428
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk03qrmnr/9e47802607eb41aea75ae53a107fd7ba.delta /opt/stack/data/nova/instances/snapshots/tmpk03qrmnr/9e47802607eb41aea75ae53a107fd7ba {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 51939e0e-26e5-4a6c-9f85-a294036fd456 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Migration 16de4c7f-def2-4652-aad1-fba256cbc428 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.601s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk03qrmnr/9e47802607eb41aea75ae53a107fd7ba.delta /opt/stack/data/nova/instances/snapshots/tmpk03qrmnr/9e47802607eb41aea75ae53a107fd7ba" returned: 0 in 0.660s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Snapshot extracted, beginning image upload
Aug 26 22:15:32 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:32 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Deleted allocations for instance 51939e0e-26e5-4a6c-9f85-a294036fd456
Aug 26 22:15:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2ca4fc3f-43b0-4186-bf20-a5fd72be0451 tempest-ServerStableDeviceRescueTest-1771134667 tempest-ServerStableDeviceRescueTest-1771134667-project-member] Lock "51939e0e-26e5-4a6c-9f85-a294036fd456" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.722s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:15:32 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:15:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:15:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:15:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:15:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:34 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Snapshot image upload complete
Aug 26 22:15:34 user nova-compute[72929]: INFO nova.compute.manager [None req-90e092ca-1d07-4396-a2f6-3968046cd7f6 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Took 6.03 seconds to snapshot the instance on the hypervisor.
Aug 26 22:15:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:15:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:44 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088129.2909276, 51939e0e-26e5-4a6c-9f85-a294036fd456 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:15:44 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] VM Stopped (Lifecycle Event)
Aug 26 22:15:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b95cba89-811c-45e9-8c5e-3aad2b69eec6 None None] [instance: 51939e0e-26e5-4a6c-9f85-a294036fd456] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:15:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:15:53 user nova-compute[72929]: INFO nova.compute.claims [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Claim successful on node user
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:15:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.policy [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '288d81e675df48b399f1635e05700193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b4cbef9286450aba00ce7ebd1cd360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:15:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Creating image(s)
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.part --force-share --output=json" returned: 0 in 0.261s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG nova.virt.images [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] 4fadb98e-10b3-4546-840a-de38725bcc8f was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.part /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Successfully created port: 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.part /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.converted" returned: 0 in 0.368s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.355s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qahzkHjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:15:55 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:15:55 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:15:55 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json" returned: 0 in 0.260s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c92ca32-2641-4741-bc41-a3b852b8f5ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:15:55 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e06dfbe-4f04-4cfb-8d0f-0e681c55b69e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2] added
Aug 26 22:15:55 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c16adc6-a275-4f57-a430-0b33dc057dec]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d15247f-f660-49b5-bd6b-d287a5c25f2d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qahzkHjM {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qahzkHjM" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0431e1-72b9-4312-9acd-c05b2f4321bc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qahzkHjM'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[568504d2-16ad-41c8-b0fb-7cceb1941655]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8,backing_fmt=raw /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b0f03-1b79-42f0-a414-2a566df1bfad]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:15:55 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:15:55 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Successfully updated port: 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8,backing_fmt=raw /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk 1073741824" returned: 0 in 0.076s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.compute.manager [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing instance network info cache due to event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[06592788-e087-4040-81b5-297297248fc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260]
Aug 26 22:15:55 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260] successful.
Aug 26 22:15:55 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5877b977-02cf-4658-a134-2da84f682b18]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c18ca7-f597-4a6d-9661-920ecd44e646]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:15:55 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:15:55 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:15:55 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:15:55 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e9539-73c3-4a5a-b78e-eae16b749946]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qahzkHjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.network.neutron [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:15:55 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Cannot resize image /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Ensure instance console log exists: /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d380e3e1-2dc2-42f6-beba-2d66b554f69c req-d3a46d11-50e5-472e-91ce-6ad0eb8c3cb6 service nova] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance network_info: |[{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Start _get_guest_xml network_info=[{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T22:15:50Z,direct_url=<?>,disk_format='qcow2',id=4fadb98e-10b3-4546-840a-de38725bcc8f,min_disk=0,min_ram=0,name='tempest-scenario-img--1635938916',owner='01b4cbef9286450aba00ce7ebd1cd360',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T22:15:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '4fadb98e-10b3-4546-840a-de38725bcc8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:15:56 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:15:56 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T22:15:50Z,direct_url=<?>,disk_format='qcow2',id=4fadb98e-10b3-4546-840a-de38725bcc8f,min_disk=0,min_ram=0,name='tempest-scenario-img--1635938916',owner='01b4cbef9286450aba00ce7ebd1cd360',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T22:15:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-928317325',display_name='tempest-TestMinimumBasicScenario-server-928317325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-928317325',id=34,image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2xXUEMZzC+e1K2bZnbtn1r+QqlrEVEH+oUa+u8a0gY5NyM3e4C1L8CcrtE7gR2cy9DqowdK0eCNc1Hza7dw1c8XRLPksEaACWBtjlz0ASN7Na87MOqu7eWmtxhYHCVA==',key_name='tempest-TestMinimumBasicScenario-886197037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-9slf0web',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:15:54Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=0c2f1ca8-4e83-4738-8cf3-041685ef8c40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.objects.instance [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:15:56 user nova-compute[72929]:   <uuid>0c2f1ca8-4e83-4738-8cf3-041685ef8c40</uuid>
Aug 26 22:15:56 user nova-compute[72929]:   <name>instance-00000022</name>
Aug 26 22:15:56 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:15:56 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:15:56 user nova-compute[72929]:   <metadata>
Aug 26 22:15:56 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:15:56 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:15:56 user nova-compute[72929]:       <nova:name>tempest-TestMinimumBasicScenario-server-928317325</nova:name>
Aug 26 22:15:56 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:15:56</nova:creationTime>
Aug 26 22:15:56 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:15:56 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:15:56 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:15:56 user nova-compute[72929]:       <nova:owner>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:user uuid="288d81e675df48b399f1635e05700193">tempest-TestMinimumBasicScenario-1162639748-project-member</nova:user>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:project uuid="01b4cbef9286450aba00ce7ebd1cd360">tempest-TestMinimumBasicScenario-1162639748</nova:project>
Aug 26 22:15:56 user nova-compute[72929]:       </nova:owner>
Aug 26 22:15:56 user nova-compute[72929]:       <nova:root type="image" uuid="4fadb98e-10b3-4546-840a-de38725bcc8f"/>
Aug 26 22:15:56 user nova-compute[72929]:       <nova:ports>
Aug 26 22:15:56 user nova-compute[72929]:         <nova:port uuid="3632a0dc-897c-4f27-b6f8-ac192c6fbcf1">
Aug 26 22:15:56 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:15:56 user nova-compute[72929]:         </nova:port>
Aug 26 22:15:56 user nova-compute[72929]:       </nova:ports>
Aug 26 22:15:56 user nova-compute[72929]:     </nova:instance>
Aug 26 22:15:56 user nova-compute[72929]:   </metadata>
Aug 26 22:15:56 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:15:56 user nova-compute[72929]:     <system>
Aug 26 22:15:56 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:15:56 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:15:56 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:15:56 user nova-compute[72929]:       <entry name="serial">0c2f1ca8-4e83-4738-8cf3-041685ef8c40</entry>
Aug 26 22:15:56 user nova-compute[72929]:       <entry name="uuid">0c2f1ca8-4e83-4738-8cf3-041685ef8c40</entry>
Aug 26 22:15:56 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:15:56 user nova-compute[72929]:     </system>
Aug 26 22:15:56 user nova-compute[72929]:   </sysinfo>
Aug 26 22:15:56 user nova-compute[72929]:   <os>
Aug 26 22:15:56 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:15:56 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:15:56 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:15:56 user nova-compute[72929]:   </os>
Aug 26 22:15:56 user nova-compute[72929]:   <features>
Aug 26 22:15:56 user nova-compute[72929]:     <acpi/>
Aug 26 22:15:56 user nova-compute[72929]:     <apic/>
Aug 26 22:15:56 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:15:56 user nova-compute[72929]:   </features>
Aug 26 22:15:56 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:15:56 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:15:56 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:15:56 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:15:56 user nova-compute[72929]:   </clock>
Aug 26 22:15:56 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:15:56 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:15:56 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:15:56 user nova-compute[72929]:   </cpu>
Aug 26 22:15:56 user nova-compute[72929]:   <devices>
Aug 26 22:15:56 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:15:56 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:15:56 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk"/>
Aug 26 22:15:56 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:15:56 user nova-compute[72929]:     </disk>
Aug 26 22:15:56 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:15:56 user nova-compute[72929]:       <mac address="fa:16:3e:c3:64:32"/>
Aug 26 22:15:56 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:15:56 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:15:56 user nova-compute[72929]:       <target dev="tap3632a0dc-89"/>
Aug 26 22:15:56 user nova-compute[72929]:     </interface>
Aug 26 22:15:56 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:15:56 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/console.log" append="off"/>
Aug 26 22:15:56 user nova-compute[72929]:     </serial>
Aug 26 22:15:56 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:15:56 user nova-compute[72929]:     <video>
Aug 26 22:15:56 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:15:56 user nova-compute[72929]:     </video>
Aug 26 22:15:56 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:15:56 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:15:56 user nova-compute[72929]:     </rng>
Aug 26 22:15:56 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:15:56 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:15:56 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:15:56 user nova-compute[72929]:     </memballoon>
Aug 26 22:15:56 user nova-compute[72929]:   </devices>
Aug 26 22:15:56 user nova-compute[72929]: </domain>
Aug 26 22:15:56 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-928317325',display_name='tempest-TestMinimumBasicScenario-server-928317325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-928317325',id=34,image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2xXUEMZzC+e1K2bZnbtn1r+QqlrEVEH+oUa+u8a0gY5NyM3e4C1L8CcrtE7gR2cy9DqowdK0eCNc1Hza7dw1c8XRLPksEaACWBtjlz0ASN7Na87MOqu7eWmtxhYHCVA==',key_name='tempest-TestMinimumBasicScenario-886197037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-9slf0web',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:15:54Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=0c2f1ca8-4e83-4738-8cf3-041685ef8c40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG os_vif [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3632a0dc-89, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3632a0dc-89, col_values=(('external_ids', {'iface-id': '3632a0dc-897c-4f27-b6f8-ac192c6fbcf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:64:32', 'vm-uuid': '0c2f1ca8-4e83-4738-8cf3-041685ef8c40'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:56 user nova-compute[72929]: INFO os_vif [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89')
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No VIF found with MAC fa:16:3e:c3:64:32, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.508s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23664373066333365', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664373066333365', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:15:56 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:15:56 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:15:56 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:15:56 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:15:56 user nova-compute[72929]:   <serial>985fac69-2b07-49d2-bb19-86f64c9838d2</serial>
Aug 26 22:15:56 user nova-compute[72929]: </disk>
Aug 26 22:15:56 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:15:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:15:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:15:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No VIF found with MAC fa:16:3e:7a:97:51, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:15:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c27cfb78-9553-4481-a867-1ede85a05fb4 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.521s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-b13370ad-996f-4b7c-ba06-18e7868cd1ca req-8a651080-611c-4d01-8401-2f7ccf1b8632 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b13370ad-996f-4b7c-ba06-18e7868cd1ca req-8a651080-611c-4d01-8401-2f7ccf1b8632 service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b13370ad-996f-4b7c-ba06-18e7868cd1ca req-8a651080-611c-4d01-8401-2f7ccf1b8632 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b13370ad-996f-4b7c-ba06-18e7868cd1ca req-8a651080-611c-4d01-8401-2f7ccf1b8632 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-b13370ad-996f-4b7c-ba06-18e7868cd1ca req-8a651080-611c-4d01-8401-2f7ccf1b8632 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:15:59 user nova-compute[72929]: WARNING nova.compute.manager [req-b13370ad-996f-4b7c-ba06-18e7868cd1ca req-8a651080-611c-4d01-8401-2f7ccf1b8632 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state building and task_state spawning.
Aug 26 22:15:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:15:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:00 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088160.99224, 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:16:00 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] VM Resumed (Lifecycle Event)
Aug 26 22:16:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:16:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:16:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance spawned successfully.
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:01 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088160.9960809, 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:16:01 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] VM Started (Lifecycle Event)
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-13a546fb-63b1-449b-afce-e777ecd75ecd req-bf562a47-8aba-4c13-bcab-e82e7e4db021 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13a546fb-63b1-449b-afce-e777ecd75ecd req-bf562a47-8aba-4c13-bcab-e82e7e4db021 service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13a546fb-63b1-449b-afce-e777ecd75ecd req-bf562a47-8aba-4c13-bcab-e82e7e4db021 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-13a546fb-63b1-449b-afce-e777ecd75ecd req-bf562a47-8aba-4c13-bcab-e82e7e4db021 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-13a546fb-63b1-449b-afce-e777ecd75ecd req-bf562a47-8aba-4c13-bcab-e82e7e4db021 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:16:01 user nova-compute[72929]: WARNING nova.compute.manager [req-13a546fb-63b1-449b-afce-e777ecd75ecd req-bf562a47-8aba-4c13-bcab-e82e7e4db021 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state building and task_state spawning.
Aug 26 22:16:01 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:16:01 user nova-compute[72929]: INFO nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Took 7.44 seconds to spawn the instance on the hypervisor.
Aug 26 22:16:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:01 user nova-compute[72929]: INFO nova.compute.manager [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Took 8.19 seconds to build instance.
Aug 26 22:16:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ca077a4f-e040-43c3-a23a-8c59fc3c957e tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.306s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:03 user nova-compute[72929]: INFO nova.compute.manager [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attaching volume c2e995d8-279c-4087-b52b-8eec124a2b9c to /dev/vdc
Aug 26 22:16:03 user nova-compute[72929]: DEBUG os_brick.utils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a254b080-ccbb-4382-8cac-47ed5618dc85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced6363a-6d45-42fc-9829-14d290ccda7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15112f5-05b0-4734-9b51-507302f51587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c36dc-479d-45a7-a1c5-a2cc9986dd6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:16:03 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:16:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[956a62a2-76da-4242-a670-874bfce14eab]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG os_brick.utils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:03 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updating existing volume attachment record: efafaec6-a46c-47fb-93ea-edf222b31314 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:16:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Going to confirm migration 2 {{(pid=72929) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuoQsXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:17 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:16:17 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:16:17 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f91faaf-70db-4f12-90fe-3bb35fce6c45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:16:17 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'info_cache' on Instance uuid 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d29f84f-7b5b-4424-aafd-ecec932a1317]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c] added
Aug 26 22:16:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[80732af4-718c-4f27-911f-2af83729099e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa8b094-7e71-4d2a-a813-23642349ddea]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMuoQsXD {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dMuoQsXD" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[def33638-7432-4674-905f-67c927598c6c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dMuoQsXD'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a741ae9-673e-437a-bf30-174adca70ff6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e482922c-c7b2-4a55-89ff-b8c7ae780eb0]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4399a5f2-c4fb-445d-a6ac-3bf85b7e2aa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260]
Aug 26 22:16:17 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260] successful.
Aug 26 22:16:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30562b1-685c-4982-b539-34d7ee2c7fe2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6a6fec-88f7-44fb-ad8d-4302d7384313]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)
Aug 26 22:16:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:16:17 user nova-compute[72929]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)
Aug 26 22:16:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a893fd47-d268-445d-91b6-0c1865a1f868]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'migration_context' on Instance uuid 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.objects.base [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Object Instance<21b46025-5ff1-4bf1-a9a0-fd7a1549c705> lazy-loaded attributes: info_cache,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.491s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuoQsXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23063386433303237', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063386433303237', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:16:18 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:16:18 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:16:18 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:16:18 user nova-compute[72929]:   <serial>c2e995d8-279c-4087-b52b-8eec124a2b9c</serial>
Aug 26 22:16:18 user nova-compute[72929]: </disk>
Aug 26 22:16:18 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:16:18 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Deleted allocation for migration 16de4c7f-def2-4652-aad1-fba256cbc428
Aug 26 22:16:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b6fe1f12-cc81-4a8a-843f-7b3dcba8e6f1 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.695s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:16:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:16:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:16:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] No VIF found with MAC fa:16:3e:7a:97:51, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:16:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b0cee35d-ed73-48a1-a0ef-604d587dc300 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.734s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:20 user nova-compute[72929]: INFO nova.compute.manager [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Detaching volume 985fac69-2b07-49d2-bb19-86f64c9838d2
Aug 26 22:16:20 user nova-compute[72929]: INFO nova.virt.block_device [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attempting to driver detach volume 985fac69-2b07-49d2-bb19-86f64c9838d2 from mountpoint /dev/vdb
Aug 26 22:16:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Attempting to detach device vdb from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:16:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:16:20 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:16:20 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:16:20 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:16:20 user nova-compute[72929]:   <serial>985fac69-2b07-49d2-bb19-86f64c9838d2</serial>
Aug 26 22:16:20 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:16:20 user nova-compute[72929]: </disk>
Aug 26 22:16:20 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:16:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully detached device vdb from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the persistent domain config.
Aug 26 22:16:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:16:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:16:20 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:16:20 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:16:20 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:16:20 user nova-compute[72929]:   <serial>985fac69-2b07-49d2-bb19-86f64c9838d2</serial>
Aug 26 22:16:20 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:16:20 user nova-compute[72929]: </disk>
Aug 26 22:16:20 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088181.0284636, 7f3b60d4-d395-4859-9109-c2e052aebdb9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:16:21 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully detached device vdb from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the live domain config.
Aug 26 22:16:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qahzkHjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:21 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a91b86-9d95-4238-81f3-9a28e5e41079]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79a67f-5e1d-48b0-8388-ae762cc9b681]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:21 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:16:21 user nova-compute[72929]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)
Aug 26 22:16:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:21 user nova-compute[72929]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 (non-flash)
Aug 26 22:16:21 user nova-compute[72929]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)
Aug 26 22:16:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba01bbbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc865c-6281-4e44-b3dc-01fd05f72e6c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a05e707-2261-4356-b0c7-927f486790f6]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6fcc0-6c10-49fb-a1cc-2a57847ec481]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdd564a-b693-4a5a-8562-579400c71add]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf74c8-2658-4165-9aac-acdc2c474c1e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f47e62-06b2-450d-9093-829b07137708]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260]
Aug 26 22:16:21 user nova-compute[72929]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2, portal: 172.16.0.220,3260] successful.
Aug 26 22:16:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:985fac69-2b07-49d2-bb19-86f64c9838d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[410e89f8-455f-4323-b49b-c0854c9ea166]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== disconnect_volume: return (313ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:16:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:22 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e83a80b7-5166-4beb-a9f5-b88ddc8b5336 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:23 user nova-compute[72929]: INFO nova.compute.manager [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Detaching volume c2e995d8-279c-4087-b52b-8eec124a2b9c
Aug 26 22:16:23 user nova-compute[72929]: INFO nova.virt.block_device [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Attempting to driver detach volume c2e995d8-279c-4087-b52b-8eec124a2b9c from mountpoint /dev/vdc
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Attempting to detach device vdc from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:16:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:16:23 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:16:23 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:16:23 user nova-compute[72929]:   <serial>c2e995d8-279c-4087-b52b-8eec124a2b9c</serial>
Aug 26 22:16:23 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 22:16:23 user nova-compute[72929]: </disk>
Aug 26 22:16:23 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:16:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully detached device vdc from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the persistent domain config.
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:16:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:16:23 user nova-compute[72929]:   <source dev="/dev/sdd"/>
Aug 26 22:16:23 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:16:23 user nova-compute[72929]:   <serial>c2e995d8-279c-4087-b52b-8eec124a2b9c</serial>
Aug 26 22:16:23 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 22:16:23 user nova-compute[72929]: </disk>
Aug 26 22:16:23 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088183.566947, 7f3b60d4-d395-4859-9109-c2e052aebdb9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:16:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully detached device vdc from instance 7f3b60d4-d395-4859-9109-c2e052aebdb9 from the live domain config.
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dMuoQsXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:23 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76e7407-ad94-49f6-a126-d41b6cf3d8c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cc9c1b-85c1-44f6-bff5-1ef3c500a8af]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:23 user nova-compute[72929]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)
Aug 26 22:16:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:23 user nova-compute[72929]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c (non-flash)
Aug 26 22:16:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803bdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67513d5a-f0b3-4873-a701-3b14ec200905]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed26929d-9cca-4d69-9450-dcd82f3f0605]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05c1179-5179-451e-9740-ef1e044cc468]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9c0e6e-e49f-4a74-b192-ad02d793a1ea]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad264f07-487a-419a-9617-4327cfe03986]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1eb61f-4f3c-4ea6-ab14-b924f2ec1280]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260]
Aug 26 22:16:23 user nova-compute[72929]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c, portal: 172.16.0.220,3260] successful.
Aug 26 22:16:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2e995d8-279c-4087-b52b-8eec124a2b9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac48940-9e3c-43c4-9496-4cdc24f497ca]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] <== disconnect_volume: return (348ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:16:24 user nova-compute[72929]: DEBUG nova.objects.instance [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'flavor' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-39be7f1c-d363-4dc7-8294-b4fb1ca69345 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.865s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:25 user nova-compute[72929]: INFO nova.compute.manager [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Terminating instance
Aug 26 22:16:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-28cdbbb0-95ed-4365-af1e-3ee17234039f req-5155a672-f2b4-4d86-8e96-053db333e9e7 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-vif-unplugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-28cdbbb0-95ed-4365-af1e-3ee17234039f req-5155a672-f2b4-4d86-8e96-053db333e9e7 service nova] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-28cdbbb0-95ed-4365-af1e-3ee17234039f req-5155a672-f2b4-4d86-8e96-053db333e9e7 service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-28cdbbb0-95ed-4365-af1e-3ee17234039f req-5155a672-f2b4-4d86-8e96-053db333e9e7 service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-28cdbbb0-95ed-4365-af1e-3ee17234039f req-5155a672-f2b4-4d86-8e96-053db333e9e7 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] No waiting events found dispatching network-vif-unplugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-28cdbbb0-95ed-4365-af1e-3ee17234039f req-5155a672-f2b4-4d86-8e96-053db333e9e7 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-vif-unplugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:16:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Instance destroyed successfully.
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.objects.instance [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lazy-loading 'resources' on Instance uuid 7f3b60d4-d395-4859-9109-c2e052aebdb9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:13:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1878679145',display_name='tempest-AttachVolumeTestJSON-server-1878679145',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1878679145',id=32,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPM0CrzBlXYupSIF/nDamqPetdUmLnaTt2IZkXMQjS/EZUIFDu8cWKIhC9sD8wwpdsEB/3lE8LgbT08dncrwIUKA5rs+grEEX2NW73CO2NjT0a7WTwa0cAXPrU4LkRibPw==',key_name='tempest-keypair-1850158011',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:13:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='675048d1f37047e1bb05a2619fac538f',ramdisk_id='',reservation_id='r-rn93lam8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1023625544',owner_user_name='tempest-AttachVolumeTestJSON-1023625544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:13:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8e8fa1fcb0b4fa5aac66bdeee20b647',uuid=7f3b60d4-d395-4859-9109-c2e052aebdb9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converting VIF {"id": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "address": "fa:16:3e:7a:97:51", "network": {"id": "43c6adf7-fdba-47ae-afba-e69d5b8aa2b0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1129779358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "675048d1f37047e1bb05a2619fac538f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d0c2da8-01", "ovs_interfaceid": "2d0c2da8-0185-47cf-970c-54f99f3d63e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG os_vif [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d0c2da8-01, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:26 user nova-compute[72929]: INFO os_vif [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:97:51,bridge_name='br-int',has_traffic_filtering=True,id=2d0c2da8-0185-47cf-970c-54f99f3d63e9,network=Network(43c6adf7-fdba-47ae-afba-e69d5b8aa2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d0c2da8-01')
Aug 26 22:16:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Deleting instance files /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9_del
Aug 26 22:16:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Deletion of /opt/stack/data/nova/instances/7f3b60d4-d395-4859-9109-c2e052aebdb9_del complete
Aug 26 22:16:26 user nova-compute[72929]: INFO nova.compute.manager [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 22:16:26 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:16:26 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:16:27 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:16:27 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Took 0.93 seconds to deallocate network for instance.
Aug 26 22:16:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-597e5009-b391-42b7-bf03-793d0aa33a9b req-04ab51b3-2b2c-4826-a1c3-76604c9c1c96 service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-vif-deleted-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:28 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Deleted allocations for instance 7f3b60d4-d395-4859-9109-c2e052aebdb9
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-a5f22f0d-c9cd-4167-af40-7c57df79e5c2 tempest-AttachVolumeTestJSON-1023625544 tempest-AttachVolumeTestJSON-1023625544-project-member] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.437s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-6666fe4e-43c8-46cc-a1a0-6926a41fbc78 req-11eff4e4-c51d-4dc9-8d30-d36bec75482b service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received event network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6666fe4e-43c8-46cc-a1a0-6926a41fbc78 req-11eff4e4-c51d-4dc9-8d30-d36bec75482b service nova] Acquiring lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6666fe4e-43c8-46cc-a1a0-6926a41fbc78 req-11eff4e4-c51d-4dc9-8d30-d36bec75482b service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6666fe4e-43c8-46cc-a1a0-6926a41fbc78 req-11eff4e4-c51d-4dc9-8d30-d36bec75482b service nova] Lock "7f3b60d4-d395-4859-9109-c2e052aebdb9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-6666fe4e-43c8-46cc-a1a0-6926a41fbc78 req-11eff4e4-c51d-4dc9-8d30-d36bec75482b service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] No waiting events found dispatching network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:16:28 user nova-compute[72929]: WARNING nova.compute.manager [req-6666fe4e-43c8-46cc-a1a0-6926a41fbc78 req-11eff4e4-c51d-4dc9-8d30-d36bec75482b service nova] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Received unexpected event network-vif-plugged-2d0c2da8-0185-47cf-970c-54f99f3d63e9 for instance with vm_state deleted and task_state None.
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:16:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:16:29 user nova-compute[72929]: INFO nova.compute.claims [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Claim successful on node user
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.348s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:16:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:16:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:16:30 user nova-compute[72929]: INFO nova.virt.block_device [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Booting with volume 008a85d8-b5e2-40f3-9fad-916b78c4044a at /dev/vda
Aug 26 22:16:30 user nova-compute[72929]: DEBUG nova.policy [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '814a67adaa1c4fdea167130c337403ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48d5337fa05b4872a0589f369a799195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG os_brick.utils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8ec368-3e0d-4088-92c5-bb60bda3c751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ba6f2-d73a-4cc2-a208-bd5c96d459c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a0aab5-6b13-4cf8-b00a-3abefa5eeae8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4a9ceb-4a7f-4a56-a5ae-6bb92ad8b86f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:16:30 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0855b7-5f66-4e82-a79b-685a2a393ddf]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG os_brick.utils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] <== get_connector_properties: return (182ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating existing volume attachment record: fea1873b-891d-4a9a-a305-44e67144a8a7 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:16:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Successfully created port: fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:16:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:16:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8041MB free_disk=24.187210083007812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:16:31 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:16:32 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:16:32 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:16:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:16:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Successfully updated port: fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing instance network info cache due to event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance network_info: |[{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:16:33 user nova-compute[72929]: DEBUG nova.network.neutron [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:16:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updated VIF entry in instance network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:16:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:16:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7667bfc7-a25d-43a6-874d-18ef0c1e1a13 req-fe78f01e-535f-47ce-950b-0a8186e5db04 service nova] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:16:36 user nova-compute[72929]: INFO nova.compute.claims [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Claim successful on node user
Aug 26 22:16:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:16:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:16:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:16:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:16:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:16:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:16:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:16:37 user nova-compute[72929]: INFO nova.virt.block_device [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Booting with blank volume at /dev/vda
Aug 26 22:16:37 user nova-compute[72929]: DEBUG nova.policy [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc2833663e85431fa3433a128520c8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc89a603c20492d9a2f41085f0e10f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Successfully created port: 481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Successfully updated port: 481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:16:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG nova.compute.manager [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-changed-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG nova.compute.manager [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Refreshing instance network info cache due to event network-changed-481b80f1-1b38-4cc5-a217-6a742bf6b0f1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance network_info: |[{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:16:39 user nova-compute[72929]: DEBUG nova.network.neutron [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Refreshing network info cache for port 481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:16:40 user nova-compute[72929]: DEBUG nova.network.neutron [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updated VIF entry in instance network info cache for port 481b80f1-1b38-4cc5-a217-6a742bf6b0f1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:16:40 user nova-compute[72929]: DEBUG nova.network.neutron [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:16:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-127f3b3e-ca87-4188-989d-ccde44e9bce3 req-03f8be94-cf25-4c62-8a43-92da7a32c85d service nova] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:16:41 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088186.6195846, 7f3b60d4-d395-4859-9109-c2e052aebdb9 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:16:41 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] VM Stopped (Lifecycle Event)
Aug 26 22:16:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7e0ffdb6-b8a8-45e9-a520-00239d609c14 None None] [instance: 7f3b60d4-d395-4859-9109-c2e052aebdb9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:16:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Creating image(s)
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Ensure instance console log exists: /opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Start _get_guest_xml network_info=[{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'fea1873b-891d-4a9a-a305-44e67144a8a7', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b278bf0-b061-48a8-86e2-c1f7680bd6e4', 'attached_at': '', 'detached_at': '', 'volume_id': '008a85d8-b5e2-40f3-9fad-916b78c4044a', 'serial': '008a85d8-b5e2-40f3-9fad-916b78c4044a'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:16:43 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:16:43 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:43 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:16:43 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:16:43 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e83190c-7d05-47e4-a00c-2f80044298f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:16:43 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eca1eeb-a444-4b97-83aa-e331234a99d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a] added
Aug 26 22:16:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fe6f81-8454-4363-9c92-4628cdf6b223]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7d30d-e21e-4b61-87ea-f6043b84d94e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTEGpafH {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTEGpafH" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e769d-b3a8-492e-a044-680ca62faafb]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTEGpafH'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4c7eba-0574-40af-8ae2-1a533b0e2e5d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5f4996-43b7-4f4a-80d6-0178e64efc27]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0382f56-c536-4b58-883e-bfcd7ad2a944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]
Aug 26 22:16:43 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.
Aug 26 22:16:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01841a3-f1f7-4ed3-b8bf-09e32779de7a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[323f3fbd-3758-48e9-93db-2cd01dfd37f8]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:43 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:16:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:16:43 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:16:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[12181897-f146-40fb-88f0-5e6af1d90301]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:16:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23437323931666532', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437323931666532', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-921211666',display_name='tempest-TestShelveInstance-server-921211666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-921211666',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemdFX1cO+B8kuenIxngh+ThWWNvP/EU6LN1bX44C97F6N1TQvhO2AvND4k6LCdffbdaS7EHlRHd8ulCpjGZPdYbaJSb2sBemNpFh0o5X1cDHQBw2QemZcRrFGnc/reqw==',key_name='tempest-TestShelveInstance-1482362583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48d5337fa05b4872a0589f369a799195',ramdisk_id='',reservation_id='r-oj2wastp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1331467690',owner_user_name='tempest-TestShelveInstance-1331467690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:16:30Z,user_data=None,user_id='814a67adaa1c4fdea167130c337403ef',uuid=1b278bf0-b061-48a8-86e2-c1f7680bd6e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converting VIF {"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.objects.instance [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:16:44 user nova-compute[72929]:   <uuid>1b278bf0-b061-48a8-86e2-c1f7680bd6e4</uuid>
Aug 26 22:16:44 user nova-compute[72929]:   <name>instance-00000023</name>
Aug 26 22:16:44 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:16:44 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:16:44 user nova-compute[72929]:   <metadata>
Aug 26 22:16:44 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:16:44 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:16:44 user nova-compute[72929]:       <nova:name>tempest-TestShelveInstance-server-921211666</nova:name>
Aug 26 22:16:44 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:16:43</nova:creationTime>
Aug 26 22:16:44 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:16:44 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:16:44 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:16:44 user nova-compute[72929]:       <nova:owner>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:user uuid="814a67adaa1c4fdea167130c337403ef">tempest-TestShelveInstance-1331467690-project-member</nova:user>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:project uuid="48d5337fa05b4872a0589f369a799195">tempest-TestShelveInstance-1331467690</nova:project>
Aug 26 22:16:44 user nova-compute[72929]:       </nova:owner>
Aug 26 22:16:44 user nova-compute[72929]:       <nova:ports>
Aug 26 22:16:44 user nova-compute[72929]:         <nova:port uuid="fcda8100-bab8-4241-b6d2-b0be62aec358">
Aug 26 22:16:44 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 22:16:44 user nova-compute[72929]:         </nova:port>
Aug 26 22:16:44 user nova-compute[72929]:       </nova:ports>
Aug 26 22:16:44 user nova-compute[72929]:     </nova:instance>
Aug 26 22:16:44 user nova-compute[72929]:   </metadata>
Aug 26 22:16:44 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:16:44 user nova-compute[72929]:     <system>
Aug 26 22:16:44 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:16:44 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:16:44 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:16:44 user nova-compute[72929]:       <entry name="serial">1b278bf0-b061-48a8-86e2-c1f7680bd6e4</entry>
Aug 26 22:16:44 user nova-compute[72929]:       <entry name="uuid">1b278bf0-b061-48a8-86e2-c1f7680bd6e4</entry>
Aug 26 22:16:44 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:16:44 user nova-compute[72929]:     </system>
Aug 26 22:16:44 user nova-compute[72929]:   </sysinfo>
Aug 26 22:16:44 user nova-compute[72929]:   <os>
Aug 26 22:16:44 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:16:44 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:16:44 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:16:44 user nova-compute[72929]:   </os>
Aug 26 22:16:44 user nova-compute[72929]:   <features>
Aug 26 22:16:44 user nova-compute[72929]:     <acpi/>
Aug 26 22:16:44 user nova-compute[72929]:     <apic/>
Aug 26 22:16:44 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:16:44 user nova-compute[72929]:   </features>
Aug 26 22:16:44 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:16:44 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:16:44 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:16:44 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:16:44 user nova-compute[72929]:   </clock>
Aug 26 22:16:44 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:16:44 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:16:44 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:16:44 user nova-compute[72929]:   </cpu>
Aug 26 22:16:44 user nova-compute[72929]:   <devices>
Aug 26 22:16:44 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:16:44 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:16:44 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:16:44 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:16:44 user nova-compute[72929]:       <serial>008a85d8-b5e2-40f3-9fad-916b78c4044a</serial>
Aug 26 22:16:44 user nova-compute[72929]:     </disk>
Aug 26 22:16:44 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:16:44 user nova-compute[72929]:       <mac address="fa:16:3e:e8:9f:ea"/>
Aug 26 22:16:44 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:16:44 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:16:44 user nova-compute[72929]:       <target dev="tapfcda8100-ba"/>
Aug 26 22:16:44 user nova-compute[72929]:     </interface>
Aug 26 22:16:44 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:16:44 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4/console.log" append="off"/>
Aug 26 22:16:44 user nova-compute[72929]:     </serial>
Aug 26 22:16:44 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:16:44 user nova-compute[72929]:     <video>
Aug 26 22:16:44 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:16:44 user nova-compute[72929]:     </video>
Aug 26 22:16:44 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:16:44 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:16:44 user nova-compute[72929]:     </rng>
Aug 26 22:16:44 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:16:44 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:16:44 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:16:44 user nova-compute[72929]:     </memballoon>
Aug 26 22:16:44 user nova-compute[72929]:   </devices>
Aug 26 22:16:44 user nova-compute[72929]: </domain>
Aug 26 22:16:44 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-921211666',display_name='tempest-TestShelveInstance-server-921211666',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-921211666',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemdFX1cO+B8kuenIxngh+ThWWNvP/EU6LN1bX44C97F6N1TQvhO2AvND4k6LCdffbdaS7EHlRHd8ulCpjGZPdYbaJSb2sBemNpFh0o5X1cDHQBw2QemZcRrFGnc/reqw==',key_name='tempest-TestShelveInstance-1482362583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48d5337fa05b4872a0589f369a799195',ramdisk_id='',reservation_id='r-oj2wastp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1331467690',owner_user_name='tempest-TestShelveInstance-1331467690-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:16:30Z,user_data=None,user_id='814a67adaa1c4fdea167130c337403ef',uuid=1b278bf0-b061-48a8-86e2-c1f7680bd6e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converting VIF {"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG os_vif [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcda8100-ba, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcda8100-ba, col_values=(('external_ids', {'iface-id': 'fcda8100-bab8-4241-b6d2-b0be62aec358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:9f:ea', 'vm-uuid': '1b278bf0-b061-48a8-86e2-c1f7680bd6e4'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:44 user nova-compute[72929]: INFO os_vif [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba')
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:16:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] No VIF found with MAC fa:16:3e:e8:9f:ea, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-0d046a6d-5ce9-4059-9b24-45d35f3ebcf8 req-1db69e20-3c4d-4ac4-9b2d-ecdf2c5f9675 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0d046a6d-5ce9-4059-9b24-45d35f3ebcf8 req-1db69e20-3c4d-4ac4-9b2d-ecdf2c5f9675 service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0d046a6d-5ce9-4059-9b24-45d35f3ebcf8 req-1db69e20-3c4d-4ac4-9b2d-ecdf2c5f9675 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0d046a6d-5ce9-4059-9b24-45d35f3ebcf8 req-1db69e20-3c4d-4ac4-9b2d-ecdf2c5f9675 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-0d046a6d-5ce9-4059-9b24-45d35f3ebcf8 req-1db69e20-3c4d-4ac4-9b2d-ecdf2c5f9675 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:16:46 user nova-compute[72929]: WARNING nova.compute.manager [req-0d046a6d-5ce9-4059-9b24-45d35f3ebcf8 req-1db69e20-3c4d-4ac4-9b2d-ecdf2c5f9675 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state building and task_state spawning.
Aug 26 22:16:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG os_brick.utils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b3090-67ee-4282-8743-f63cefa52dce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a42deb3-5837-4333-bf1b-1b44d3a2bf26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[07826287-2127-4d03-9314-aac3d6fbdb7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503ec53-2eeb-47bf-a7e6-bd40a59743f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:16:47 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:16:47 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43aee2-0506-4c63-928c-153bd6a8af34]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG os_brick.utils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:16:47 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating existing volume attachment record: 047bc632-6156-4b2f-9a16-3c97db1f2659 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088208.473532, 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] VM Resumed (Lifecycle Event)
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance spawned successfully.
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088208.4767694, 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] VM Started (Lifecycle Event)
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Took 5.36 seconds to spawn the instance on the hypervisor.
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-8804e884-e530-4b11-8da1-68edca02bbf1 req-502fcb7a-9112-468b-a6e4-dccf4c803252 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8804e884-e530-4b11-8da1-68edca02bbf1 req-502fcb7a-9112-468b-a6e4-dccf4c803252 service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8804e884-e530-4b11-8da1-68edca02bbf1 req-502fcb7a-9112-468b-a6e4-dccf4c803252 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8804e884-e530-4b11-8da1-68edca02bbf1 req-502fcb7a-9112-468b-a6e4-dccf4c803252 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-8804e884-e530-4b11-8da1-68edca02bbf1 req-502fcb7a-9112-468b-a6e4-dccf4c803252 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:16:48 user nova-compute[72929]: WARNING nova.compute.manager [req-8804e884-e530-4b11-8da1-68edca02bbf1 req-502fcb7a-9112-468b-a6e4-dccf4c803252 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state building and task_state spawning.
Aug 26 22:16:48 user nova-compute[72929]: INFO nova.compute.manager [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Took 19.39 seconds to build instance.
Aug 26 22:16:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-27ae4b47-6cec-41d1-9771-e6a59bef9311 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.541s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:16:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:16:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:17:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Creating image(s)
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Ensure instance console log exists: /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Start _get_guest_xml network_info=[{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '047bc632-6156-4b2f-9a16-3c97db1f2659', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1', 'attached_at': '', 'detached_at': '', 'volume_id': '3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df', 'serial': '3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:17:01 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:17:01 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:17:01 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:17:01 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:17:01 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7780a3-9138-4fff-ac3a-4f2784f8c002]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:17:01 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f602ac3-9153-4084-a34f-d4b241e1c07a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df] added
Aug 26 22:17:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.154s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f006b-bfb5-4ae6-9a5e-730a8b908dee]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd8d0a4-a667-40e0-8ca9-e8970eb2e8ac]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vheukKVP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vheukKVP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c00b59a-e5b3-42dc-be85-25c4cd8dff32]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vheukKVP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a148c9af-cfd2-4a85-a170-d8f860c645a5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1e8fb4-8e52-49c2-b7ae-4a6cfb49ea84]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:17:01 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:17:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:17:01 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:17:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f117c8aa-8b2f-426e-bfdf-e72d623a5c2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260]
Aug 26 22:17:01 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260] successful.
Aug 26 22:17:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[16444918-4fcb-4ca1-820e-4261935e6f71]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88127cd-84df-46db-9397-45b0459f31cd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:17:01 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:17:01 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:17:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:17:01 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:17:01 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:17:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.473s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef08c67-85b0-4c6e-86cc-26c8e1ef485b]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== connect_volume: return (1515ms) {'type': 'block', 'scsi_wwn': '26439336366653830', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439336366653830', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1078351751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1078351751',id=36,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-kaq3z0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:16:37Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:17:02 user nova-compute[72929]:   <uuid>1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1</uuid>
Aug 26 22:17:02 user nova-compute[72929]:   <name>instance-00000024</name>
Aug 26 22:17:02 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:17:02 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:17:02 user nova-compute[72929]:   <metadata>
Aug 26 22:17:02 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:17:02 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:17:02 user nova-compute[72929]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1078351751</nova:name>
Aug 26 22:17:02 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:17:01</nova:creationTime>
Aug 26 22:17:02 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:17:02 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:17:02 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:17:02 user nova-compute[72929]:       <nova:owner>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:user uuid="cc2833663e85431fa3433a128520c8a8">tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member</nova:user>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:project uuid="dcc89a603c20492d9a2f41085f0e10f5">tempest-ServerBootFromVolumeStableRescueTest-650830425</nova:project>
Aug 26 22:17:02 user nova-compute[72929]:       </nova:owner>
Aug 26 22:17:02 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:17:02 user nova-compute[72929]:       <nova:ports>
Aug 26 22:17:02 user nova-compute[72929]:         <nova:port uuid="481b80f1-1b38-4cc5-a217-6a742bf6b0f1">
Aug 26 22:17:02 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 22:17:02 user nova-compute[72929]:         </nova:port>
Aug 26 22:17:02 user nova-compute[72929]:       </nova:ports>
Aug 26 22:17:02 user nova-compute[72929]:     </nova:instance>
Aug 26 22:17:02 user nova-compute[72929]:   </metadata>
Aug 26 22:17:02 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:17:02 user nova-compute[72929]:     <system>
Aug 26 22:17:02 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:17:02 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:17:02 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:17:02 user nova-compute[72929]:       <entry name="serial">1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1</entry>
Aug 26 22:17:02 user nova-compute[72929]:       <entry name="uuid">1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1</entry>
Aug 26 22:17:02 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:17:02 user nova-compute[72929]:     </system>
Aug 26 22:17:02 user nova-compute[72929]:   </sysinfo>
Aug 26 22:17:02 user nova-compute[72929]:   <os>
Aug 26 22:17:02 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:17:02 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:17:02 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:17:02 user nova-compute[72929]:   </os>
Aug 26 22:17:02 user nova-compute[72929]:   <features>
Aug 26 22:17:02 user nova-compute[72929]:     <acpi/>
Aug 26 22:17:02 user nova-compute[72929]:     <apic/>
Aug 26 22:17:02 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:17:02 user nova-compute[72929]:   </features>
Aug 26 22:17:02 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:17:02 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:17:02 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:17:02 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:17:02 user nova-compute[72929]:   </clock>
Aug 26 22:17:02 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:17:02 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:17:02 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:17:02 user nova-compute[72929]:   </cpu>
Aug 26 22:17:02 user nova-compute[72929]:   <devices>
Aug 26 22:17:02 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:17:02 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:17:02 user nova-compute[72929]:       <source dev="/dev/sdd"/>
Aug 26 22:17:02 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:17:02 user nova-compute[72929]:       <serial>3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df</serial>
Aug 26 22:17:02 user nova-compute[72929]:     </disk>
Aug 26 22:17:02 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:17:02 user nova-compute[72929]:       <mac address="fa:16:3e:de:ea:57"/>
Aug 26 22:17:02 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:17:02 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:17:02 user nova-compute[72929]:       <target dev="tap481b80f1-1b"/>
Aug 26 22:17:02 user nova-compute[72929]:     </interface>
Aug 26 22:17:02 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:17:02 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/console.log" append="off"/>
Aug 26 22:17:02 user nova-compute[72929]:     </serial>
Aug 26 22:17:02 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:17:02 user nova-compute[72929]:     <video>
Aug 26 22:17:02 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:17:02 user nova-compute[72929]:     </video>
Aug 26 22:17:02 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:17:02 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:17:02 user nova-compute[72929]:     </rng>
Aug 26 22:17:02 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:17:02 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:17:02 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:17:02 user nova-compute[72929]:     </memballoon>
Aug 26 22:17:02 user nova-compute[72929]:   </devices>
Aug 26 22:17:02 user nova-compute[72929]: </domain>
Aug 26 22:17:02 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1078351751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1078351751',id=36,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-kaq3z0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:16:37Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG os_vif [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap481b80f1-1b, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap481b80f1-1b, col_values=(('external_ids', {'iface-id': '481b80f1-1b38-4cc5-a217-6a742bf6b0f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:ea:57', 'vm-uuid': '1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:17:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:02 user nova-compute[72929]: INFO os_vif [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b')
Aug 26 22:17:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:17:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No VIF found with MAC fa:16:3e:de:ea:57, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:17:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-d60a7f53-44a6-49f3-a04a-45b23dcad4c2 req-39f2e49a-f584-4730-a417-c179934b8cf8 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d60a7f53-44a6-49f3-a04a-45b23dcad4c2 req-39f2e49a-f584-4730-a417-c179934b8cf8 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d60a7f53-44a6-49f3-a04a-45b23dcad4c2 req-39f2e49a-f584-4730-a417-c179934b8cf8 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d60a7f53-44a6-49f3-a04a-45b23dcad4c2 req-39f2e49a-f584-4730-a417-c179934b8cf8 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-d60a7f53-44a6-49f3-a04a-45b23dcad4c2 req-39f2e49a-f584-4730-a417-c179934b8cf8 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:17:04 user nova-compute[72929]: WARNING nova.compute.manager [req-d60a7f53-44a6-49f3-a04a-45b23dcad4c2 req-39f2e49a-f584-4730-a417-c179934b8cf8 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state building and task_state spawning.
Aug 26 22:17:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-05bc43c4-cdc5-4e15-8eae-b896ca25c079 req-2e0c3513-9da3-4f5b-a124-78ea1e6277a6 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:17:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05bc43c4-cdc5-4e15-8eae-b896ca25c079 req-2e0c3513-9da3-4f5b-a124-78ea1e6277a6 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05bc43c4-cdc5-4e15-8eae-b896ca25c079 req-2e0c3513-9da3-4f5b-a124-78ea1e6277a6 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-05bc43c4-cdc5-4e15-8eae-b896ca25c079 req-2e0c3513-9da3-4f5b-a124-78ea1e6277a6 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-05bc43c4-cdc5-4e15-8eae-b896ca25c079 req-2e0c3513-9da3-4f5b-a124-78ea1e6277a6 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:17:06 user nova-compute[72929]: WARNING nova.compute.manager [req-05bc43c4-cdc5-4e15-8eae-b896ca25c079 req-2e0c3513-9da3-4f5b-a124-78ea1e6277a6 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state building and task_state spawning.
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088227.0396361, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Resumed (Lifecycle Event)
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance spawned successfully.
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088227.0409544, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Started (Lifecycle Event)
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 26 22:17:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:07 user nova-compute[72929]: INFO nova.compute.manager [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Took 30.63 seconds to build instance.
Aug 26 22:17:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0f2020f9-6423-40f4-abd5-bc8efd26245d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.748s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:29 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:32 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:17:32 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8009MB free_disk=24.171897888183594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:17:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid c1608933-05ed-4314-a13b-a48035aa841b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:17:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [{"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:17:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-c1608933-05ed-4314-a13b-a48035aa841b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:17:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:17:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:17:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:17:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:17:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:17:42 user nova-compute[72929]: INFO nova.compute.claims [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Claim successful on node user
Aug 26 22:17:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.network.neutron [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:17:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:17:43 user nova-compute[72929]: DEBUG nova.policy [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf31c30629f7485a9b160f8d853096dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6b106b16484bfa8fd629b57527130f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:17:43 user nova-compute[72929]: INFO nova.virt.block_device [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Booting with volume snapshot fcb8967b-2711-4be4-94d2-6d0d2c8b284c at /dev/vda
Aug 26 22:17:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Successfully created port: 64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Successfully updated port: 64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "refresh_cache-fd304c02-bd28-485d-8783-f00dd52c95f0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquired lock "refresh_cache-fd304c02-bd28-485d-8783-f00dd52c95f0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-changed-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Refreshing instance network info cache due to event network-changed-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] Acquiring lock "refresh_cache-fd304c02-bd28-485d-8783-f00dd52c95f0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Updating instance_info_cache with network_info: [{"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Releasing lock "refresh_cache-fd304c02-bd28-485d-8783-f00dd52c95f0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Instance network_info: |[{"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] Acquired lock "refresh_cache-fd304c02-bd28-485d-8783-f00dd52c95f0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:17:45 user nova-compute[72929]: DEBUG nova.network.neutron [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Refreshing network info cache for port 64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:17:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Updated VIF entry in instance network info cache for port 64c69905-5aaf-4bca-b3b9-dd5de44ab9d2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:17:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Updating instance_info_cache with network_info: [{"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:17:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-917dfd5d-6452-40f7-a429-316d55cc3ada req-dfb0fb90-b508-4e18-bca6-da3dcb580d28 service nova] Releasing lock "refresh_cache-fd304c02-bd28-485d-8783-f00dd52c95f0" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:17:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'flavor' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:17:49 user nova-compute[72929]: INFO nova.compute.manager [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Attaching volume ad8fc906-dc32-4dc7-ad1f-2080c5621d00 to /dev/vdb
Aug 26 22:17:49 user nova-compute[72929]: DEBUG os_brick.utils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0193581c-32e8-4751-b234-13af1b4037f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc645ad0-861d-4a63-9476-2507aec77410]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a379ca-15c3-47c7-922c-a480c8b2ce47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[40179815-442e-4e7b-b22a-048d83d7d36f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:17:49 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:17:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fe2dbc-7225-45de-a613-208aeac71909]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG os_brick.utils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:17:49 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating existing volume attachment record: 0a8d53ac-dcb6-4571-9a3f-11ceb31eceb7 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:17:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG os_brick.utils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[940478f3-9e81-445d-97ae-42621d18ee10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3171586a-15de-4791-a5b3-8e62cf3cb0f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fe4518-3161-4d80-9706-d25649b22311]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be15571-3103-443c-817e-5e451bb328c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:17:54 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:17:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ffc9b3-a6a9-4db2-b000-cdcc8eda2450]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG os_brick.utils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:17:54 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Updating existing volume attachment record: 49c1f9a1-83de-4e50-ac2e-3c9e372b437e {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:17:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:18:02 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:02 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:02 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e05c6-c65b-442c-a2b4-6c4a783d9317]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:18:02 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6720a4a-a91a-45d9-b9b8-33c99b662db4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00] added
Aug 26 22:18:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[060e6096-c335-4c5b-bd15-6b45c55b5983]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f019b88-1fe0-4081-a560-e66c833fd728]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIbnPUiY {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIbnPUiY" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd258025-472f-49b1-9251-fe2366c75fa4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JIbnPUiY'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf3cd6-8d40-4ac3-90e1-1d4581584191]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667e947-7144-4abc-bd20-64e55bc499b4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a981d787-28e1-4fbb-86ef-fabd9038a7a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]
Aug 26 22:18:02 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.
Aug 26 22:18:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.071s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[140271ed-0651-4702-be88-092dccfe7f47]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a606ab-7ab2-4d45-9c2f-321e300fc9ed]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:02 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aca688-de50-4181-b7ed-9ce1eb09ba88]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:18:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:18:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26634623332613465', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634623332613465', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG nova.objects.instance [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'flavor' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:18:04 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:18:04 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:18:04 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:18:04 user nova-compute[72929]:   <serial>ad8fc906-dc32-4dc7-ad1f-2080c5621d00</serial>
Aug 26 22:18:04 user nova-compute[72929]: </disk>
Aug 26 22:18:04 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No VIF found with MAC fa:16:3e:c3:64:32, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:18:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-155d8e33-38a8-433d-95b0-4e50c73435bd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.569s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:18:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Creating image(s)
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Ensure instance console log exists: /opt/stack/data/nova/instances/fd304c02-bd28-485d-8783-f00dd52c95f0/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Start _get_guest_xml network_info=[{"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '49c1f9a1-83de-4e50-ac2e-3c9e372b437e', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPQDAXNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd304c02-bd28-485d-8783-f00dd52c95f0', 'attached_at': '', 'detached_at': '', 'volume_id': 'e111a8e1-ddf8-4c64-8c10-5bc75122ccba', 'serial': 'e111a8e1-ddf8-4c64-8c10-5bc75122ccba'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:18:07 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:07 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPQDAXNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:18:07 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:07 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:07 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc11f786-97c6-4e32-af58-d6f4081d8b55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:18:07 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[732e7a4f-b642-47b7-8a6e-4f2d062aea51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba] added
Aug 26 22:18:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f26fb9-7492-4ce7-9adf-4d933bdfebc8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e816937-7c8b-44cb-8ad4-9037799cc156]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPQDAXNl {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPQDAXNl" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977da90-af5c-4705-8e8d-075a46b8b3cd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPQDAXNl'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db76ea6-5858-4200-84a5-4fe3df3f0258]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[51789cc4-850b-4649-8a1e-e9996f960d69]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2083ff3-d229-461c-9235-3ea45fae13c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260]
Aug 26 22:18:07 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260] successful.
Aug 26 22:18:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c341a-761b-4f14-8d34-82123ad9e892]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2630d2b-21ad-4306-9c10-50d2384f70b4]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:07 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe63c19-a984-46df-bdab-22b7bd8fd405]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:18:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPQDAXNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23463663763346630', 'path': '/dev/sdf'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463663763346630', 'path': '/dev/sdf'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-31810582',display_name='tempest-TestVolumeBootPattern-server-31810582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-31810582',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-88arzd59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:17:43Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=fd304c02-bd28-485d-8783-f00dd52c95f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.objects.instance [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'pci_devices' on Instance uuid fd304c02-bd28-485d-8783-f00dd52c95f0 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:18:08 user nova-compute[72929]:   <uuid>fd304c02-bd28-485d-8783-f00dd52c95f0</uuid>
Aug 26 22:18:08 user nova-compute[72929]:   <name>instance-00000025</name>
Aug 26 22:18:08 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:18:08 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:18:08 user nova-compute[72929]:   <metadata>
Aug 26 22:18:08 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:18:08 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:18:08 user nova-compute[72929]:       <nova:name>tempest-TestVolumeBootPattern-server-31810582</nova:name>
Aug 26 22:18:08 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:18:07</nova:creationTime>
Aug 26 22:18:08 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:18:08 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:18:08 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:18:08 user nova-compute[72929]:       <nova:owner>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:user uuid="cf31c30629f7485a9b160f8d853096dc">tempest-TestVolumeBootPattern-1716061349-project-member</nova:user>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:project uuid="ea6b106b16484bfa8fd629b57527130f">tempest-TestVolumeBootPattern-1716061349</nova:project>
Aug 26 22:18:08 user nova-compute[72929]:       </nova:owner>
Aug 26 22:18:08 user nova-compute[72929]:       <nova:ports>
Aug 26 22:18:08 user nova-compute[72929]:         <nova:port uuid="64c69905-5aaf-4bca-b3b9-dd5de44ab9d2">
Aug 26 22:18:08 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 22:18:08 user nova-compute[72929]:         </nova:port>
Aug 26 22:18:08 user nova-compute[72929]:       </nova:ports>
Aug 26 22:18:08 user nova-compute[72929]:     </nova:instance>
Aug 26 22:18:08 user nova-compute[72929]:   </metadata>
Aug 26 22:18:08 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:18:08 user nova-compute[72929]:     <system>
Aug 26 22:18:08 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:18:08 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:18:08 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:18:08 user nova-compute[72929]:       <entry name="serial">fd304c02-bd28-485d-8783-f00dd52c95f0</entry>
Aug 26 22:18:08 user nova-compute[72929]:       <entry name="uuid">fd304c02-bd28-485d-8783-f00dd52c95f0</entry>
Aug 26 22:18:08 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:18:08 user nova-compute[72929]:     </system>
Aug 26 22:18:08 user nova-compute[72929]:   </sysinfo>
Aug 26 22:18:08 user nova-compute[72929]:   <os>
Aug 26 22:18:08 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:18:08 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:18:08 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:18:08 user nova-compute[72929]:   </os>
Aug 26 22:18:08 user nova-compute[72929]:   <features>
Aug 26 22:18:08 user nova-compute[72929]:     <acpi/>
Aug 26 22:18:08 user nova-compute[72929]:     <apic/>
Aug 26 22:18:08 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:18:08 user nova-compute[72929]:   </features>
Aug 26 22:18:08 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:18:08 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:18:08 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:18:08 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:18:08 user nova-compute[72929]:   </clock>
Aug 26 22:18:08 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:18:08 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:18:08 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:18:08 user nova-compute[72929]:   </cpu>
Aug 26 22:18:08 user nova-compute[72929]:   <devices>
Aug 26 22:18:08 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:18:08 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:18:08 user nova-compute[72929]:       <source dev="/dev/sdf"/>
Aug 26 22:18:08 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:18:08 user nova-compute[72929]:       <serial>e111a8e1-ddf8-4c64-8c10-5bc75122ccba</serial>
Aug 26 22:18:08 user nova-compute[72929]:     </disk>
Aug 26 22:18:08 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:18:08 user nova-compute[72929]:       <mac address="fa:16:3e:fe:be:ad"/>
Aug 26 22:18:08 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:18:08 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:18:08 user nova-compute[72929]:       <target dev="tap64c69905-5a"/>
Aug 26 22:18:08 user nova-compute[72929]:     </interface>
Aug 26 22:18:08 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:18:08 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/fd304c02-bd28-485d-8783-f00dd52c95f0/console.log" append="off"/>
Aug 26 22:18:08 user nova-compute[72929]:     </serial>
Aug 26 22:18:08 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:18:08 user nova-compute[72929]:     <video>
Aug 26 22:18:08 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:18:08 user nova-compute[72929]:     </video>
Aug 26 22:18:08 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:18:08 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:18:08 user nova-compute[72929]:     </rng>
Aug 26 22:18:08 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:18:08 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:18:08 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:18:08 user nova-compute[72929]:     </memballoon>
Aug 26 22:18:08 user nova-compute[72929]:   </devices>
Aug 26 22:18:08 user nova-compute[72929]: </domain>
Aug 26 22:18:08 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-31810582',display_name='tempest-TestVolumeBootPattern-server-31810582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-31810582',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-88arzd59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:17:43Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=fd304c02-bd28-485d-8783-f00dd52c95f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG os_vif [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c69905-5a, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64c69905-5a, col_values=(('external_ids', {'iface-id': '64c69905-5aaf-4bca-b3b9-dd5de44ab9d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:be:ad', 'vm-uuid': 'fd304c02-bd28-485d-8783-f00dd52c95f0'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:08 user nova-compute[72929]: INFO os_vif [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a')
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:18:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No VIF found with MAC fa:16:3e:fe:be:ad, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:18:09 user nova-compute[72929]: INFO nova.compute.manager [None req-43f30190-6461-4c9a-b79e-68073e028315 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Get console output
Aug 26 22:18:09 user nova-compute[72929]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-20e4f226-f405-4480-ae69-edaa72692797 req-990e0de3-3135-4928-a16c-eccfad4391f9 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-20e4f226-f405-4480-ae69-edaa72692797 req-990e0de3-3135-4928-a16c-eccfad4391f9 service nova] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-20e4f226-f405-4480-ae69-edaa72692797 req-990e0de3-3135-4928-a16c-eccfad4391f9 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-20e4f226-f405-4480-ae69-edaa72692797 req-990e0de3-3135-4928-a16c-eccfad4391f9 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-20e4f226-f405-4480-ae69-edaa72692797 req-990e0de3-3135-4928-a16c-eccfad4391f9 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] No waiting events found dispatching network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:10 user nova-compute[72929]: WARNING nova.compute.manager [req-20e4f226-f405-4480-ae69-edaa72692797 req-990e0de3-3135-4928-a16c-eccfad4391f9 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received unexpected event network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 for instance with vm_state building and task_state spawning.
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-49e6a96c-38da-4568-87aa-7bf43925638e req-93cca82e-415f-4484-8689-e29cafd19ba8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-49e6a96c-38da-4568-87aa-7bf43925638e req-93cca82e-415f-4484-8689-e29cafd19ba8 service nova] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-49e6a96c-38da-4568-87aa-7bf43925638e req-93cca82e-415f-4484-8689-e29cafd19ba8 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-49e6a96c-38da-4568-87aa-7bf43925638e req-93cca82e-415f-4484-8689-e29cafd19ba8 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-49e6a96c-38da-4568-87aa-7bf43925638e req-93cca82e-415f-4484-8689-e29cafd19ba8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] No waiting events found dispatching network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:12 user nova-compute[72929]: WARNING nova.compute.manager [req-49e6a96c-38da-4568-87aa-7bf43925638e req-93cca82e-415f-4484-8689-e29cafd19ba8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received unexpected event network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 for instance with vm_state building and task_state spawning.
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088292.6607132, fd304c02-bd28-485d-8783-f00dd52c95f0 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] VM Resumed (Lifecycle Event)
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Instance spawned successfully.
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088292.663054, fd304c02-bd28-485d-8783-f00dd52c95f0 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] VM Started (Lifecycle Event)
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Took 5.57 seconds to spawn the instance on the hypervisor.
Aug 26 22:18:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:12 user nova-compute[72929]: INFO nova.compute.manager [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Took 29.97 seconds to build instance.
Aug 26 22:18:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-fbc312af-02bb-491c-9a60-9652bcaa3843 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.066s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing instance network info cache due to event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG nova.network.neutron [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:18:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updated VIF entry in instance network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:18:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-03ab2c50-c7a7-45f5-b2c7-7e32c23d9540 req-082a9d86-1473-4353-bcd9-b3250e6c5e2f service nova] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing instance network info cache due to event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:18:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:18:21 user nova-compute[72929]: DEBUG nova.network.neutron [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updated VIF entry in instance network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:18:21 user nova-compute[72929]: DEBUG nova.network.neutron [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cdefb09c-358d-4bab-b445-310009eb86c1 req-ef586b6b-30fd-4cba-b7c4-0abebbcb95a0 service nova] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing instance network info cache due to event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updated VIF entry in instance network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4d1ec9be-77d9-466c-92d6-248962aa8d9f req-cd3da52d-dd24-4c73-87ed-f6ef01f00471 service nova] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:23 user nova-compute[72929]: INFO nova.compute.manager [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Shelve offloading
Aug 26 22:18:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-8122587a-0d7e-4e0f-9b84-fffd4c56dcc8 req-189b58fa-08cc-46ca-82f6-49061f52cabc service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-unplugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8122587a-0d7e-4e0f-9b84-fffd4c56dcc8 req-189b58fa-08cc-46ca-82f6-49061f52cabc service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8122587a-0d7e-4e0f-9b84-fffd4c56dcc8 req-189b58fa-08cc-46ca-82f6-49061f52cabc service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8122587a-0d7e-4e0f-9b84-fffd4c56dcc8 req-189b58fa-08cc-46ca-82f6-49061f52cabc service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-8122587a-0d7e-4e0f-9b84-fffd4c56dcc8 req-189b58fa-08cc-46ca-82f6-49061f52cabc service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-unplugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:24 user nova-compute[72929]: WARNING nova.compute.manager [req-8122587a-0d7e-4e0f-9b84-fffd4c56dcc8 req-189b58fa-08cc-46ca-82f6-49061f52cabc service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-unplugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state active and task_state shelving.
Aug 26 22:18:24 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance destroyed successfully.
Aug 26 22:18:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:24 user nova-compute[72929]: DEBUG nova.network.neutron [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:18:25 user nova-compute[72929]: DEBUG nova.network.neutron [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-3d7af6cc-18e9-4011-94bf-cab29287449b req-a6b2bff1-fb9b-403f-a831-0af48f191e56 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d7af6cc-18e9-4011-94bf-cab29287449b req-a6b2bff1-fb9b-403f-a831-0af48f191e56 service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d7af6cc-18e9-4011-94bf-cab29287449b req-a6b2bff1-fb9b-403f-a831-0af48f191e56 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3d7af6cc-18e9-4011-94bf-cab29287449b req-a6b2bff1-fb9b-403f-a831-0af48f191e56 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-3d7af6cc-18e9-4011-94bf-cab29287449b req-a6b2bff1-fb9b-403f-a831-0af48f191e56 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:26 user nova-compute[72929]: WARNING nova.compute.manager [req-3d7af6cc-18e9-4011-94bf-cab29287449b req-a6b2bff1-fb9b-403f-a831-0af48f191e56 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state active and task_state shelving.
Aug 26 22:18:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance destroyed successfully.
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.objects.instance [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'resources' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-921211666',display_name='tempest-TestShelveInstance-server-921211666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-921211666',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemdFX1cO+B8kuenIxngh+ThWWNvP/EU6LN1bX44C97F6N1TQvhO2AvND4k6LCdffbdaS7EHlRHd8ulCpjGZPdYbaJSb2sBemNpFh0o5X1cDHQBw2QemZcRrFGnc/reqw==',key_name='tempest-TestShelveInstance-1482362583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48d5337fa05b4872a0589f369a799195',ramdisk_id='',reservation_id='r-oj2wastp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1331467690',owner_user_name='tempest-TestShelveInstance-1331467690-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:16:49Z,user_data=None,user_id='814a67adaa1c4fdea167130c337403ef',uuid=1b278bf0-b061-48a8-86e2-c1f7680bd6e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converting VIF {"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_vif [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcda8100-ba, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:26 user nova-compute[72929]: INFO os_vif [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba')
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:18:26 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a93cc58-f8f0-4761-af1f-8176eef0e163]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcaf85f-ee77-44d0-9bc7-c9c556eecd3e]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:26 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803cc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09c83de-9465-4fb6-8031-5b33c8ebbfa7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.compute.manager [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing instance network info cache due to event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.network.neutron [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b03d1f-bcae-4c68-823f-5ec62e2addc0]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[12607368-6ff6-4021-8c73-3948ede5737b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eebaa58-0668-4fb6-b143-e31a88abcb3d]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f31d0c-42f3-49e5-b184-01e225fb2f48]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d859b82d-ffe5-40c2-a806-44c3f8042e85]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]
Aug 26 22:18:26 user nova-compute[72929]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.
Aug 26 22:18:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70f3782-1779-4655-b385-0216ddee1285]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] <== disconnect_volume: return (355ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:18:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:18:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Deleting instance files /opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4_del
Aug 26 22:18:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Deletion of /opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4_del complete
Aug 26 22:18:27 user nova-compute[72929]: DEBUG nova.network.neutron [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updated VIF entry in instance network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:18:27 user nova-compute[72929]: DEBUG nova.network.neutron [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": null, "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfcda8100-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0c862168-b279-4431-a45e-deae772c479c req-5849afa8-8215-4d3b-92df-94e0a6dcb09b service nova] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:27 user nova-compute[72929]: INFO nova.compute.manager [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Rescuing
Aug 26 22:18:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:27 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:18:27 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Deleted allocations for instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.objects.instance [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.objects.base [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Object Instance<1b278bf0-b061-48a8-86e2-c1f7680bd6e4> lazy-loaded attributes: resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-432282d6-7dd8-468b-9f8b-cf16d92738cc tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.463s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-01943659-95e0-4beb-ab70-1d13214c7659 req-25f0c6da-3915-4aaa-8bb1-17fef9166657 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-01943659-95e0-4beb-ab70-1d13214c7659 req-25f0c6da-3915-4aaa-8bb1-17fef9166657 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-01943659-95e0-4beb-ab70-1d13214c7659 req-25f0c6da-3915-4aaa-8bb1-17fef9166657 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-01943659-95e0-4beb-ab70-1d13214c7659 req-25f0c6da-3915-4aaa-8bb1-17fef9166657 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-01943659-95e0-4beb-ab70-1d13214c7659 req-25f0c6da-3915-4aaa-8bb1-17fef9166657 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:28 user nova-compute[72929]: WARNING nova.compute.manager [req-01943659-95e0-4beb-ab70-1d13214c7659 req-25f0c6da-3915-4aaa-8bb1-17fef9166657 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state rescuing.
Aug 26 22:18:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance destroyed successfully.
Aug 26 22:18:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Attempting a stable device rescue
Aug 26 22:18:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72929) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:18:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Creating image(s)
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:29 user nova-compute[72929]: INFO nova.compute.manager [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Rebooting instance
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.part --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG nova.virt.images [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] 5da2613d-dfd9-4c6e-8b2b-6bffa407cabf was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.part /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-f3e82708-b851-4086-873a-1e7d1541a890 req-8f24e5af-af42-4787-9faf-a0fbfc249788 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f3e82708-b851-4086-873a-1e7d1541a890 req-8f24e5af-af42-4787-9faf-a0fbfc249788 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f3e82708-b851-4086-873a-1e7d1541a890 req-8f24e5af-af42-4787-9faf-a0fbfc249788 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f3e82708-b851-4086-873a-1e7d1541a890 req-8f24e5af-af42-4787-9faf-a0fbfc249788 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:30 user nova-compute[72929]: DEBUG nova.compute.manager [req-f3e82708-b851-4086-873a-1e7d1541a890 req-8f24e5af-af42-4787-9faf-a0fbfc249788 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:30 user nova-compute[72929]: WARNING nova.compute.manager [req-f3e82708-b851-4086-873a-1e7d1541a890 req-8f24e5af-af42-4787-9faf-a0fbfc249788 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state rescuing.
Aug 26 22:18:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.part /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.converted" returned: 0 in 0.545s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.969s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-6f3a5eb3-4395-4ee6-b7e4-59907dceb08e req-9d48d55f-a766-4dcc-80fe-eb3a78545336 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-unplugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6f3a5eb3-4395-4ee6-b7e4-59907dceb08e req-9d48d55f-a766-4dcc-80fe-eb3a78545336 service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6f3a5eb3-4395-4ee6-b7e4-59907dceb08e req-9d48d55f-a766-4dcc-80fe-eb3a78545336 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6f3a5eb3-4395-4ee6-b7e4-59907dceb08e req-9d48d55f-a766-4dcc-80fe-eb3a78545336 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-6f3a5eb3-4395-4ee6-b7e4-59907dceb08e req-9d48d55f-a766-4dcc-80fe-eb3a78545336 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-unplugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:31 user nova-compute[72929]: WARNING nova.compute.manager [req-6f3a5eb3-4395-4ee6-b7e4-59907dceb08e req-9d48d55f-a766-4dcc-80fe-eb3a78545336 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-unplugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8 --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8,backing_fmt=raw /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8,backing_fmt=raw /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue" returned: 0 in 0.061s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'migration_context' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Start _get_guest_xml network_info=[{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "vif_mac": "fa:16:3e:de:ea:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5da2613d-dfd9-4c6e-8b2b-6bffa407cabf', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '047bc632-6156-4b2f-9a16-3c97db1f2659', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1', 'attached_at': '', 'detached_at': '', 'volume_id': '3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df', 'serial': '3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'resources' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'numa_topology' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:18:31 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:31 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:31 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca15922c-08f5-4808-9d28-bbf04acb26f9]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vheukKVP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 22:18:31 user nova-compute[72929]: node.name = iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df
Aug 26 22:18:31 user nova-compute[72929]: node.tpgt = -1
Aug 26 22:18:31 user nova-compute[72929]: node.startup = automatic
Aug 26 22:18:31 user nova-compute[72929]: node.leading_login = No
Aug 26 22:18:31 user nova-compute[72929]: iface.iscsi_ifacename = default
Aug 26 22:18:31 user nova-compute[72929]: iface.net_ifacename = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.ipaddress = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.prefix_len = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.hwaddress = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.transport_name = tcp
Aug 26 22:18:31 user nova-compute[72929]: iface.initiatorname = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.vlan_id = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.vlan_priority = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.vlan_state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.iface_num = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.mtu = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.port = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.bootproto = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.subnet_mask = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.gateway = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_alt_client_id = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_dns = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_learn_iqn = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_vendor_id_state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_vendor_id = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.dhcp_slp_da = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.fragmentation = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.gratuitous_arp = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.incoming_forwarding = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.tos_state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.tos = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.ttl = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.delayed_ack = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.tcp_nagle = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.tcp_wsf_state = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.tcp_wsf = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.tcp_timer_scale = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.tcp_timestamp = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.redirect = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.def_task_mgmt_timeout = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.header_digest = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.data_digest = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.immediate_data = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.initial_r2t = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.data_seq_inorder = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.data_pdu_inorder = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.erl = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.max_receive_data_len = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.first_burst_len = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.max_outstanding_r2t = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.max_burst_len = 0
Aug 26 22:18:31 user nova-compute[72929]: iface.chap_auth = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.bidi_chap = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.strict_login_compliance = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.discovery_auth = <empty>
Aug 26 22:18:31 user nova-compute[72929]: iface.discovery_logout = <empty>
Aug 26 22:18:31 user nova-compute[72929]: node.discovery_address = <empty>
Aug 26 22:18:31 user nova-compute[72929]: node.discovery_port = 0
Aug 26 22:18:31 user nova-compute[72929]: node.discovery_type = static
Aug 26 22:18:31 user nova-compute[72929]: node.session.initial_cmdsn = 0
Aug 26 22:18:31 user nova-compute[72929]: node.session.initial_login_retry_max = 8
Aug 26 22:18:31 user nova-compute[72929]: node.session.xmit_thread_priority = -20
Aug 26 22:18:31 user nova-compute[72929]: node.session.cmds_max = 128
Aug 26 22:18:31 user nova-compute[72929]: node.session.queue_depth = 32
Aug 26 22:18:31 user nova-compute[72929]: node.session.nr_sessions = 1
Aug 26 22:18:31 user nova-compute[72929]: node.session.auth.authmethod = CHAP
Aug 26 22:18:31 user nova-compute[72929]: node.session.auth.username = vheukKVP
Aug 26 22:18:31 user nova-compute[72929]: node.session.auth.password = ***
Aug 26 22:18:31 user nova-compute[72929]: node.session.auth.username_in = <empty>
Aug 26 22:18:31 user nova-compute[72929]: node.session.auth.password_in = <empty>
Aug 26 22:18:31 user nova-compute[72929]: node.session.auth.chap_algs = MD5
Aug 26 22:18:31 user nova-compute[72929]: node.session.timeo.replacement_timeout = 120
Aug 26 22:18:31 user nova-compute[72929]: node.session.err_timeo.abort_timeout = 15
Aug 26 22:18:31 user nova-compute[72929]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 22:18:31 user nova-compute[72929]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 22:18:31 user nova-compute[72929]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.FastAbort = Yes
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.InitialR2T = No
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.ImmediateData = Yes
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.MaxConnections = 1
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 22:18:31 user nova-compute[72929]: node.session.iscsi.ERL = 0
Aug 26 22:18:31 user nova-compute[72929]: node.session.scan = manual
Aug 26 22:18:31 user nova-compute[72929]: node.session.reopen_max = 0
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].address = 172.16.0.220
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].port = 3260
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].startup = manual
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].tcp.window_size = 524288
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].tcp.type_of_service = 0
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].timeo.logout_timeout = 15
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].timeo.login_timeout = 15
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].timeo.auth_timeout = 45
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].iscsi.DataDigest = None
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].iscsi.IFMarker = No
Aug 26 22:18:31 user nova-compute[72929]: node.conn[0].iscsi.OFMarker = No
Aug 26 22:18:31 user nova-compute[72929]: # END RECORD
Aug 26 22:18:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[45447313-3d41-4210-a7e4-598575c8138b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d99409d-0475-478d-9917-f0d85342f2d5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vheukKVP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vheukKVP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad67b2-e9fa-49ba-ba03-9ae65beeec0c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vheukKVP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcad63a-2539-403b-a5b5-380f6da17796]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e5d1c-ec99-4cae-83e6-e92841b02326]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] HCTL ('35', '0', '0', 0) found on session 42 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a1fe62-1304-4c47-abbe-0aae6c01a1c5]: (4, ('0 0 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching for a device in session 42 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '26439336366653830', 'path': '/dev/sdd'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439336366653830', 'path': '/dev/sdd'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1078351751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1078351751',id=36,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:17:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-kaq3z0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:17:07Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "vif_mac": "fa:16:3e:de:ea:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "vif_mac": "fa:16:3e:de:ea:57"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.base [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:18:31 user nova-compute[72929]:   <uuid>1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1</uuid>
Aug 26 22:18:31 user nova-compute[72929]:   <name>instance-00000024</name>
Aug 26 22:18:31 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:18:31 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:18:31 user nova-compute[72929]:   <metadata>
Aug 26 22:18:31 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:18:31 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:18:31 user nova-compute[72929]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1078351751</nova:name>
Aug 26 22:18:31 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:18:31</nova:creationTime>
Aug 26 22:18:31 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:18:31 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:18:31 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:18:31 user nova-compute[72929]:       <nova:owner>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:user uuid="cc2833663e85431fa3433a128520c8a8">tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member</nova:user>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:project uuid="dcc89a603c20492d9a2f41085f0e10f5">tempest-ServerBootFromVolumeStableRescueTest-650830425</nova:project>
Aug 26 22:18:31 user nova-compute[72929]:       </nova:owner>
Aug 26 22:18:31 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:18:31 user nova-compute[72929]:       <nova:ports>
Aug 26 22:18:31 user nova-compute[72929]:         <nova:port uuid="481b80f1-1b38-4cc5-a217-6a742bf6b0f1">
Aug 26 22:18:31 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 22:18:31 user nova-compute[72929]:         </nova:port>
Aug 26 22:18:31 user nova-compute[72929]:       </nova:ports>
Aug 26 22:18:31 user nova-compute[72929]:     </nova:instance>
Aug 26 22:18:31 user nova-compute[72929]:   </metadata>
Aug 26 22:18:31 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:18:31 user nova-compute[72929]:     <system>
Aug 26 22:18:31 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:18:31 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:18:31 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:18:31 user nova-compute[72929]:       <entry name="serial">1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1</entry>
Aug 26 22:18:31 user nova-compute[72929]:       <entry name="uuid">1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1</entry>
Aug 26 22:18:31 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:18:31 user nova-compute[72929]:     </system>
Aug 26 22:18:31 user nova-compute[72929]:   </sysinfo>
Aug 26 22:18:31 user nova-compute[72929]:   <os>
Aug 26 22:18:31 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:18:31 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:18:31 user nova-compute[72929]:   </os>
Aug 26 22:18:31 user nova-compute[72929]:   <features>
Aug 26 22:18:31 user nova-compute[72929]:     <acpi/>
Aug 26 22:18:31 user nova-compute[72929]:     <apic/>
Aug 26 22:18:31 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:18:31 user nova-compute[72929]:   </features>
Aug 26 22:18:31 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:18:31 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:18:31 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:18:31 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:18:31 user nova-compute[72929]:   </clock>
Aug 26 22:18:31 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:18:31 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:18:31 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:18:31 user nova-compute[72929]:   </cpu>
Aug 26 22:18:31 user nova-compute[72929]:   <devices>
Aug 26 22:18:31 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:18:31 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:18:31 user nova-compute[72929]:       <source dev="/dev/sdd"/>
Aug 26 22:18:31 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:18:31 user nova-compute[72929]:       <serial>3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df</serial>
Aug 26 22:18:31 user nova-compute[72929]:     </disk>
Aug 26 22:18:31 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:18:31 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:18:31 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue"/>
Aug 26 22:18:31 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:18:31 user nova-compute[72929]:       <boot order="1"/>
Aug 26 22:18:31 user nova-compute[72929]:     </disk>
Aug 26 22:18:31 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:18:31 user nova-compute[72929]:       <mac address="fa:16:3e:de:ea:57"/>
Aug 26 22:18:31 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:18:31 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:18:31 user nova-compute[72929]:       <target dev="tap481b80f1-1b"/>
Aug 26 22:18:31 user nova-compute[72929]:     </interface>
Aug 26 22:18:31 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:18:31 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/console.log" append="off"/>
Aug 26 22:18:31 user nova-compute[72929]:     </serial>
Aug 26 22:18:31 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:18:31 user nova-compute[72929]:     <video>
Aug 26 22:18:31 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:18:31 user nova-compute[72929]:     </video>
Aug 26 22:18:31 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:18:31 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:18:31 user nova-compute[72929]:     </rng>
Aug 26 22:18:31 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:18:31 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:18:31 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:18:31 user nova-compute[72929]:     </memballoon>
Aug 26 22:18:31 user nova-compute[72929]:   </devices>
Aug 26 22:18:31 user nova-compute[72929]: </domain>
Aug 26 22:18:31 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:18:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance destroyed successfully.
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'resources' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance destroyed successfully.
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-928317325',display_name='tempest-TestMinimumBasicScenario-server-928317325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-928317325',id=34,image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2xXUEMZzC+e1K2bZnbtn1r+QqlrEVEH+oUa+u8a0gY5NyM3e4C1L8CcrtE7gR2cy9DqowdK0eCNc1Hza7dw1c8XRLPksEaACWBtjlz0ASN7Na87MOqu7eWmtxhYHCVA==',key_name='tempest-TestMinimumBasicScenario-886197037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-9slf0web',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:18:31Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=0c2f1ca8-4e83-4738-8cf3-041685ef8c40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3632a0dc-89, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:31 user nova-compute[72929]: INFO os_vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89')
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:18:31 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[119a6bf9-4a20-48fe-b7dc-5afced725294]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No VIF found with MAC fa:16:3e:de:ea:57, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ffb5c0-4a89-40dc-baa1-edc7a7563d18]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:31 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803b1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b90230-78dc-4179-a4ae-56d2c435d5e2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c11809-5197-4e9f-ba5f-1c3e5218ed5a]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e36387-99cc-41ef-ad14-e9c96d096580]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c871791-2dbf-4c2b-841d-d9f2f284318f]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74151d8-1a9b-4dea-81ac-62bf229b88e3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e52999-8e89-42dc-a2ac-13e8aac9cb81]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]
Aug 26 22:18:32 user nova-compute[72929]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[097ce0ad-c363-4953-9c29-3a8f3d537698]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== disconnect_volume: return (278ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Start _get_guest_xml network_info=[{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fadb98e-10b3-4546-840a-de38725bcc8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '4fadb98e-10b3-4546-840a-de38725bcc8f'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '0a8d53ac-dcb6-4571-9a3f-11ceb31eceb7', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0c2f1ca8-4e83-4738-8cf3-041685ef8c40', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad8fc906-dc32-4dc7-ad1f-2080c5621d00', 'serial': 'ad8fc906-dc32-4dc7-ad1f-2080c5621d00'}, 'boot_index': None, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:18:32 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:32 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4fadb98e-10b3-4546-840a-de38725bcc8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.objects.instance [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.objects.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Object Instance<0c2f1ca8-4e83-4738-8cf3-041685ef8c40> lazy-loaded attributes: resources,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:18:32 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:32 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:18:32 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166a3d8-05ac-4276-8e0e-39e6377e2a83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:18:32 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5d8d36-b17c-4acc-a432-1b680a6354fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00] added
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dee225-7fde-4883-83a4-af04dbe7cc68]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d457aa-4f8d-4977-ba3d-94de87e6510a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIbnPUiY {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JIbnPUiY" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e85319d-860e-4aa8-9ea6-c53efcde02d1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JIbnPUiY'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b21c30-16a0-49c1-86a7-ac8f26df8a41]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[993d4172-cded-4da7-a36c-323a63a64e34]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b92e29-0d71-472d-a1f6-7dd5ac2c1eb3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]
Aug 26 22:18:32 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668c8a5-7f45-4e2b-9845-7a1d4ffdac09]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a75936e-53ff-4466-939a-9d5cdb4e30d6]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:18:32 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:18:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.087s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106ba8b-2068-4c50-a7b0-38d7aaa5d612]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:18:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [{"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-21b46025-5ff1-4bf1-a9a0-fd7a1549c705" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-1e2861cd-73d8-4fe2-8e72-f21b26c14cfb req-5a7b04a6-6451-444a-90ad-5dcbeb93489b service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1e2861cd-73d8-4fe2-8e72-f21b26c14cfb req-5a7b04a6-6451-444a-90ad-5dcbeb93489b service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1e2861cd-73d8-4fe2-8e72-f21b26c14cfb req-5a7b04a6-6451-444a-90ad-5dcbeb93489b service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1e2861cd-73d8-4fe2-8e72-f21b26c14cfb req-5a7b04a6-6451-444a-90ad-5dcbeb93489b service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-1e2861cd-73d8-4fe2-8e72-f21b26c14cfb req-5a7b04a6-6451-444a-90ad-5dcbeb93489b service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:33 user nova-compute[72929]: WARNING nova.compute.manager [req-1e2861cd-73d8-4fe2-8e72-f21b26c14cfb req-5a7b04a6-6451-444a-90ad-5dcbeb93489b service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-25de52b8-1f39-4e71-bf17-ae9703065e7b req-2d18f834-1f2b-454d-9fd3-945dacec3a9a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-25de52b8-1f39-4e71-bf17-ae9703065e7b req-2d18f834-1f2b-454d-9fd3-945dacec3a9a service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-25de52b8-1f39-4e71-bf17-ae9703065e7b req-2d18f834-1f2b-454d-9fd3-945dacec3a9a service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-25de52b8-1f39-4e71-bf17-ae9703065e7b req-2d18f834-1f2b-454d-9fd3-945dacec3a9a service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-25de52b8-1f39-4e71-bf17-ae9703065e7b req-2d18f834-1f2b-454d-9fd3-945dacec3a9a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:33 user nova-compute[72929]: WARNING nova.compute.manager [req-25de52b8-1f39-4e71-bf17-ae9703065e7b req-2d18f834-1f2b-454d-9fd3-945dacec3a9a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state rescuing.
Aug 26 22:18:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26634623332613465', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634623332613465', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-928317325',display_name='tempest-TestMinimumBasicScenario-server-928317325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-928317325',id=34,image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2xXUEMZzC+e1K2bZnbtn1r+QqlrEVEH+oUa+u8a0gY5NyM3e4C1L8CcrtE7gR2cy9DqowdK0eCNc1Hza7dw1c8XRLPksEaACWBtjlz0ASN7Na87MOqu7eWmtxhYHCVA==',key_name='tempest-TestMinimumBasicScenario-886197037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-9slf0web',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:18:31Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=0c2f1ca8-4e83-4738-8cf3-041685ef8c40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.objects.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Object Instance<0c2f1ca8-4e83-4738-8cf3-041685ef8c40> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:18:33 user nova-compute[72929]:   <uuid>0c2f1ca8-4e83-4738-8cf3-041685ef8c40</uuid>
Aug 26 22:18:33 user nova-compute[72929]:   <name>instance-00000022</name>
Aug 26 22:18:33 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:18:33 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:18:33 user nova-compute[72929]:   <metadata>
Aug 26 22:18:33 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:18:33 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:18:33 user nova-compute[72929]:       <nova:name>tempest-TestMinimumBasicScenario-server-928317325</nova:name>
Aug 26 22:18:33 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:18:32</nova:creationTime>
Aug 26 22:18:33 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:18:33 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:18:33 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:18:33 user nova-compute[72929]:       <nova:owner>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:user uuid="288d81e675df48b399f1635e05700193">tempest-TestMinimumBasicScenario-1162639748-project-member</nova:user>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:project uuid="01b4cbef9286450aba00ce7ebd1cd360">tempest-TestMinimumBasicScenario-1162639748</nova:project>
Aug 26 22:18:33 user nova-compute[72929]:       </nova:owner>
Aug 26 22:18:33 user nova-compute[72929]:       <nova:root type="image" uuid="4fadb98e-10b3-4546-840a-de38725bcc8f"/>
Aug 26 22:18:33 user nova-compute[72929]:       <nova:ports>
Aug 26 22:18:33 user nova-compute[72929]:         <nova:port uuid="3632a0dc-897c-4f27-b6f8-ac192c6fbcf1">
Aug 26 22:18:33 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:18:33 user nova-compute[72929]:         </nova:port>
Aug 26 22:18:33 user nova-compute[72929]:       </nova:ports>
Aug 26 22:18:33 user nova-compute[72929]:     </nova:instance>
Aug 26 22:18:33 user nova-compute[72929]:   </metadata>
Aug 26 22:18:33 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:18:33 user nova-compute[72929]:     <system>
Aug 26 22:18:33 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:18:33 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:18:33 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:18:33 user nova-compute[72929]:       <entry name="serial">0c2f1ca8-4e83-4738-8cf3-041685ef8c40</entry>
Aug 26 22:18:33 user nova-compute[72929]:       <entry name="uuid">0c2f1ca8-4e83-4738-8cf3-041685ef8c40</entry>
Aug 26 22:18:33 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:18:33 user nova-compute[72929]:     </system>
Aug 26 22:18:33 user nova-compute[72929]:   </sysinfo>
Aug 26 22:18:33 user nova-compute[72929]:   <os>
Aug 26 22:18:33 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:18:33 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:18:33 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:18:33 user nova-compute[72929]:   </os>
Aug 26 22:18:33 user nova-compute[72929]:   <features>
Aug 26 22:18:33 user nova-compute[72929]:     <acpi/>
Aug 26 22:18:33 user nova-compute[72929]:     <apic/>
Aug 26 22:18:33 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:18:33 user nova-compute[72929]:   </features>
Aug 26 22:18:33 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:18:33 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:18:33 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:18:33 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:18:33 user nova-compute[72929]:   </clock>
Aug 26 22:18:33 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:18:33 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:18:33 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:18:33 user nova-compute[72929]:   </cpu>
Aug 26 22:18:33 user nova-compute[72929]:   <devices>
Aug 26 22:18:33 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:18:33 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:18:33 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk"/>
Aug 26 22:18:33 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:18:33 user nova-compute[72929]:     </disk>
Aug 26 22:18:33 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:18:33 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:18:33 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:18:33 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:18:33 user nova-compute[72929]:       <serial>ad8fc906-dc32-4dc7-ad1f-2080c5621d00</serial>
Aug 26 22:18:33 user nova-compute[72929]:     </disk>
Aug 26 22:18:33 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:18:33 user nova-compute[72929]:       <mac address="fa:16:3e:c3:64:32"/>
Aug 26 22:18:33 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:18:33 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:18:33 user nova-compute[72929]:       <target dev="tap3632a0dc-89"/>
Aug 26 22:18:33 user nova-compute[72929]:     </interface>
Aug 26 22:18:33 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:18:33 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/console.log" append="off"/>
Aug 26 22:18:33 user nova-compute[72929]:     </serial>
Aug 26 22:18:33 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:18:33 user nova-compute[72929]:     <video>
Aug 26 22:18:33 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:18:33 user nova-compute[72929]:     </video>
Aug 26 22:18:33 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:18:33 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:18:33 user nova-compute[72929]:     </rng>
Aug 26 22:18:33 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:18:33 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:18:33 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:18:33 user nova-compute[72929]:     </memballoon>
Aug 26 22:18:33 user nova-compute[72929]:   </devices>
Aug 26 22:18:33 user nova-compute[72929]: </domain>
Aug 26 22:18:33 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:18:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.objects.instance [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.objects.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Object Instance<0c2f1ca8-4e83-4738-8cf3-041685ef8c40> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Cannot resize image /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.objects.instance [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'migration_context' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.objects.base [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Object Instance<0c2f1ca8-4e83-4738-8cf3-041685ef8c40> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-928317325',display_name='tempest-TestMinimumBasicScenario-server-928317325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-928317325',id=34,image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2xXUEMZzC+e1K2bZnbtn1r+QqlrEVEH+oUa+u8a0gY5NyM3e4C1L8CcrtE7gR2cy9DqowdK0eCNc1Hza7dw1c8XRLPksEaACWBtjlz0ASN7Na87MOqu7eWmtxhYHCVA==',key_name='tempest-TestMinimumBasicScenario-886197037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-9slf0web',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:18:31Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=0c2f1ca8-4e83-4738-8cf3-041685ef8c40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG os_vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3632a0dc-89, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3632a0dc-89, col_values=(('external_ids', {'iface-id': '3632a0dc-897c-4f27-b6f8-ac192c6fbcf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:64:32', 'vm-uuid': '0c2f1ca8-4e83-4738-8cf3-041685ef8c40'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:34 user nova-compute[72929]: INFO os_vif [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89')
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-e5e4f35f-80b7-4bdb-b604-1d9a6566b17c req-e2a4347c-ea54-4b46-b314-c8f191da4c2d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e5e4f35f-80b7-4bdb-b604-1d9a6566b17c req-e2a4347c-ea54-4b46-b314-c8f191da4c2d service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e5e4f35f-80b7-4bdb-b604-1d9a6566b17c req-e2a4347c-ea54-4b46-b314-c8f191da4c2d service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e5e4f35f-80b7-4bdb-b604-1d9a6566b17c req-e2a4347c-ea54-4b46-b314-c8f191da4c2d service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-e5e4f35f-80b7-4bdb-b604-1d9a6566b17c req-e2a4347c-ea54-4b46-b314-c8f191da4c2d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:35 user nova-compute[72929]: WARNING nova.compute.manager [req-e5e4f35f-80b7-4bdb-b604-1d9a6566b17c req-e2a4347c-ea54-4b46-b314-c8f191da4c2d service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state rescuing.
Aug 26 22:18:35 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:35 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8108MB free_disk=24.062721252441406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088315.9037933, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Resumed (Lifecycle Event)
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5a721a55-8ec3-453c-8a22-1291d78afe62 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance fd304c02-bd28-485d-8783-f00dd52c95f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:18:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088315.9063778, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Started (Lifecycle Event)
Aug 26 22:18:35 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c1ed94f-7c0e-486b-8661-c731804dd56c req-61cc2e84-cb20-4805-a794-034697385009 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c1ed94f-7c0e-486b-8661-c731804dd56c req-61cc2e84-cb20-4805-a794-034697385009 service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c1ed94f-7c0e-486b-8661-c731804dd56c req-61cc2e84-cb20-4805-a794-034697385009 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-6c1ed94f-7c0e-486b-8661-c731804dd56c req-61cc2e84-cb20-4805-a794-034697385009 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-6c1ed94f-7c0e-486b-8661-c731804dd56c req-61cc2e84-cb20-4805-a794-034697385009 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:36 user nova-compute[72929]: WARNING nova.compute.manager [req-6c1ed94f-7c0e-486b-8661-c731804dd56c req-61cc2e84-cb20-4805-a794-034697385009 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 22:18:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-12ec00bb-c42d-4d05-822d-b07d8fdeb41c req-067e9e19-c559-4b97-a8ca-94187d6ac267 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-12ec00bb-c42d-4d05-822d-b07d8fdeb41c req-067e9e19-c559-4b97-a8ca-94187d6ac267 service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-12ec00bb-c42d-4d05-822d-b07d8fdeb41c req-067e9e19-c559-4b97-a8ca-94187d6ac267 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-12ec00bb-c42d-4d05-822d-b07d8fdeb41c req-067e9e19-c559-4b97-a8ca-94187d6ac267 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [req-12ec00bb-c42d-4d05-822d-b07d8fdeb41c req-067e9e19-c559-4b97-a8ca-94187d6ac267 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:18:38 user nova-compute[72929]: WARNING nova.compute.manager [req-12ec00bb-c42d-4d05-822d-b07d8fdeb41c req-067e9e19-c559-4b97-a8ca-94187d6ac267 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state active and task_state reboot_started_hard.
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088318.7628398, 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:38 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] VM Resumed (Lifecycle Event)
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:18:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance rebooted successfully.
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:18:38 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088318.7662604, 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:38 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] VM Started (Lifecycle Event)
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:18:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-3e9a-4d73-a86d-71b6c8bb7e08 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.632s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:18:39 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088304.6755683, 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:18:39 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] VM Stopped (Lifecycle Event)
Aug 26 22:18:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e2770fbe-f4a5-409f-ab2c-f9660502d2eb None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:18:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:18:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:18:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:18:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:18:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:19:05 user nova-compute[72929]: INFO nova.compute.claims [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Claim successful on node user
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:19:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.policy [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '270ea6e7f5ac4e64874f9d7aaf211b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59076b100394311b871aff3d8232639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:19:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Creating image(s)
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "/opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "/opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk 1073741824" returned: 0 in 0.073s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.230s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Successfully created port: c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Cannot resize image /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Ensure instance console log exists: /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Successfully updated port: c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquired lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-changed-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Refreshing instance network info cache due to event network-changed-c8e0004f-55ae-4dd7-88ba-95ff1e23cace. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:19:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] Acquiring lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.neutron [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updating instance_info_cache with network_info: [{"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Releasing lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Instance network_info: |[{"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] Acquired lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Refreshing network info cache for port c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Start _get_guest_xml network_info=[{"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:19:09 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:19:09 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-243775865',display_name='tempest-VolumesSnapshotTestJSON-instance-243775865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-243775865',id=38,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMYIBVhDe/4WWB2oXrQNqsag5PW/UPBh2hjidErYLoMvlm8poxXy4jJcRKvw6X0sexww4E8FZbU0bR2xNPQcPnVTeeF8S+SmpJ+ATHCzRLiV2WascmQzq74mP9vO32mKQ==',key_name='tempest-keypair-278061947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59076b100394311b871aff3d8232639',ramdisk_id='',reservation_id='r-xkilem1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1269723',owner_user_name='tempest-VolumesSnapshotTestJSON-1269723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270ea6e7f5ac4e64874f9d7aaf211b33',uuid=cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converting VIF {"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'pci_devices' on Instance uuid cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:19:09 user nova-compute[72929]:   <uuid>cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9</uuid>
Aug 26 22:19:09 user nova-compute[72929]:   <name>instance-00000026</name>
Aug 26 22:19:09 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:19:09 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:19:09 user nova-compute[72929]:   <metadata>
Aug 26 22:19:09 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:19:09 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:19:09 user nova-compute[72929]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-243775865</nova:name>
Aug 26 22:19:09 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:19:09</nova:creationTime>
Aug 26 22:19:09 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:19:09 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:19:09 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:19:09 user nova-compute[72929]:       <nova:owner>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:user uuid="270ea6e7f5ac4e64874f9d7aaf211b33">tempest-VolumesSnapshotTestJSON-1269723-project-member</nova:user>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:project uuid="c59076b100394311b871aff3d8232639">tempest-VolumesSnapshotTestJSON-1269723</nova:project>
Aug 26 22:19:09 user nova-compute[72929]:       </nova:owner>
Aug 26 22:19:09 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:19:09 user nova-compute[72929]:       <nova:ports>
Aug 26 22:19:09 user nova-compute[72929]:         <nova:port uuid="c8e0004f-55ae-4dd7-88ba-95ff1e23cace">
Aug 26 22:19:09 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 22:19:09 user nova-compute[72929]:         </nova:port>
Aug 26 22:19:09 user nova-compute[72929]:       </nova:ports>
Aug 26 22:19:09 user nova-compute[72929]:     </nova:instance>
Aug 26 22:19:09 user nova-compute[72929]:   </metadata>
Aug 26 22:19:09 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:19:09 user nova-compute[72929]:     <system>
Aug 26 22:19:09 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:19:09 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:19:09 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:19:09 user nova-compute[72929]:       <entry name="serial">cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9</entry>
Aug 26 22:19:09 user nova-compute[72929]:       <entry name="uuid">cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9</entry>
Aug 26 22:19:09 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:19:09 user nova-compute[72929]:     </system>
Aug 26 22:19:09 user nova-compute[72929]:   </sysinfo>
Aug 26 22:19:09 user nova-compute[72929]:   <os>
Aug 26 22:19:09 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:19:09 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:19:09 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:19:09 user nova-compute[72929]:   </os>
Aug 26 22:19:09 user nova-compute[72929]:   <features>
Aug 26 22:19:09 user nova-compute[72929]:     <acpi/>
Aug 26 22:19:09 user nova-compute[72929]:     <apic/>
Aug 26 22:19:09 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:19:09 user nova-compute[72929]:   </features>
Aug 26 22:19:09 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:19:09 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:19:09 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:19:09 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:19:09 user nova-compute[72929]:   </clock>
Aug 26 22:19:09 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:19:09 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:19:09 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:19:09 user nova-compute[72929]:   </cpu>
Aug 26 22:19:09 user nova-compute[72929]:   <devices>
Aug 26 22:19:09 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:19:09 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:19:09 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk"/>
Aug 26 22:19:09 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:19:09 user nova-compute[72929]:     </disk>
Aug 26 22:19:09 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:19:09 user nova-compute[72929]:       <mac address="fa:16:3e:f1:6a:fe"/>
Aug 26 22:19:09 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:19:09 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:19:09 user nova-compute[72929]:       <target dev="tapc8e0004f-55"/>
Aug 26 22:19:09 user nova-compute[72929]:     </interface>
Aug 26 22:19:09 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:19:09 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/console.log" append="off"/>
Aug 26 22:19:09 user nova-compute[72929]:     </serial>
Aug 26 22:19:09 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:19:09 user nova-compute[72929]:     <video>
Aug 26 22:19:09 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:19:09 user nova-compute[72929]:     </video>
Aug 26 22:19:09 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:19:09 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:19:09 user nova-compute[72929]:     </rng>
Aug 26 22:19:09 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:19:09 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:19:09 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:19:09 user nova-compute[72929]:     </memballoon>
Aug 26 22:19:09 user nova-compute[72929]:   </devices>
Aug 26 22:19:09 user nova-compute[72929]: </domain>
Aug 26 22:19:09 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-243775865',display_name='tempest-VolumesSnapshotTestJSON-instance-243775865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-243775865',id=38,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMYIBVhDe/4WWB2oXrQNqsag5PW/UPBh2hjidErYLoMvlm8poxXy4jJcRKvw6X0sexww4E8FZbU0bR2xNPQcPnVTeeF8S+SmpJ+ATHCzRLiV2WascmQzq74mP9vO32mKQ==',key_name='tempest-keypair-278061947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59076b100394311b871aff3d8232639',ramdisk_id='',reservation_id='r-xkilem1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1269723',owner_user_name='tempest-VolumesSnapshotTestJSON-1269723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270ea6e7f5ac4e64874f9d7aaf211b33',uuid=cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converting VIF {"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG os_vif [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8e0004f-55, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8e0004f-55, col_values=(('external_ids', {'iface-id': 'c8e0004f-55ae-4dd7-88ba-95ff1e23cace', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:6a:fe', 'vm-uuid': 'cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:09 user nova-compute[72929]: INFO os_vif [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55')
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No VIF found with MAC fa:16:3e:f1:6a:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:19:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:10 user nova-compute[72929]: INFO nova.compute.manager [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Terminating instance
Aug 26 22:19:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG nova.network.neutron [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updated VIF entry in instance network info cache for port c8e0004f-55ae-4dd7-88ba-95ff1e23cace. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG nova.network.neutron [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updating instance_info_cache with network_info: [{"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8263d8ab-12ca-49d8-b3d1-2d06d34a2c80 req-8697338f-90a5-46eb-8564-fa032b8ed193 service nova] Releasing lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8a379fc-afbd-42aa-80b2-3fd7d8bd50dc req-da2ccab1-aa53-4bbe-bebf-be485840d7f2 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-unplugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8a379fc-afbd-42aa-80b2-3fd7d8bd50dc req-da2ccab1-aa53-4bbe-bebf-be485840d7f2 service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8a379fc-afbd-42aa-80b2-3fd7d8bd50dc req-da2ccab1-aa53-4bbe-bebf-be485840d7f2 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8a379fc-afbd-42aa-80b2-3fd7d8bd50dc req-da2ccab1-aa53-4bbe-bebf-be485840d7f2 service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8a379fc-afbd-42aa-80b2-3fd7d8bd50dc req-da2ccab1-aa53-4bbe-bebf-be485840d7f2 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-unplugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8a379fc-afbd-42aa-80b2-3fd7d8bd50dc req-da2ccab1-aa53-4bbe-bebf-be485840d7f2 service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-unplugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Instance destroyed successfully.
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'resources' on Instance uuid 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:12:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2038925650',display_name='tempest-ServerActionsTestOtherA-server-2038925650',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2038925650',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:14:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-2r1jp5t6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:16:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=21b46025-5ff1-4bf1-a9a0-fd7a1549c705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "address": "fa:16:3e:7d:05:e6", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c2128c-77", "ovs_interfaceid": "08c2128c-77ab-47c8-a1a4-5ef5efaee1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_vif [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08c2128c-77, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:19:11 user nova-compute[72929]: INFO os_vif [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:05:e6,bridge_name='br-int',has_traffic_filtering=True,id=08c2128c-77ab-47c8-a1a4-5ef5efaee1c2,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c2128c-77')
Aug 26 22:19:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCwhWQld', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:19:11 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[69656031-6511-4b3f-b030-3e05f6e7c3e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af2b446-91d8-4e60-8ac6-9fc8229927da]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:19:11 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:19:11 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:19:11 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:19:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 (non-flash)
Aug 26 22:19:11 user nova-compute[72929]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:19:11 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:19:11 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:19:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b9812b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a24f6-b1dd-496f-9ada-6d6eda72d6bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1cb667-6a9b-44e9-bcf6-a3e7d04a8090]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[882ea858-1ca1-45b9-b51a-faa4e7a076ec]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b354b-e977-497b-8012-88868379c205]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[95873c4f-7da4-4362-a640-2814c717ba98]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc83cfb-1b15-47de-a522-2674c1fe7edc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260]
Aug 26 22:19:12 user nova-compute[72929]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4, portal: 172.16.0.220,3260] successful.
Aug 26 22:19:12 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3275dd5a-5692-4278-a8ae-0849bcd3681d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] <== disconnect_volume: return (316ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:19:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Deleting instance files /opt/stack/data/nova/instances/21b46025-5ff1-4bf1-a9a0-fd7a1549c705_del
Aug 26 22:19:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Deletion of /opt/stack/data/nova/instances/21b46025-5ff1-4bf1-a9a0-fd7a1549c705_del complete
Aug 26 22:19:12 user nova-compute[72929]: INFO nova.compute.manager [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Took 1.98 seconds to destroy the instance on the hypervisor.
Aug 26 22:19:12 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:19:12 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Acquiring lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] No waiting events found dispatching network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:13 user nova-compute[72929]: WARNING nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received unexpected event network-vif-plugged-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 for instance with vm_state active and task_state deleting.
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] No waiting events found dispatching network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:13 user nova-compute[72929]: WARNING nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received unexpected event network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace for instance with vm_state building and task_state spawning.
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] No waiting events found dispatching network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:13 user nova-compute[72929]: WARNING nova.compute.manager [req-2d69259d-b34f-4399-bb01-1522167c53be req-d7f747b3-0575-4a77-89de-8241abd863fe service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received unexpected event network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace for instance with vm_state building and task_state spawning.
Aug 26 22:19:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:13 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Took 1.05 seconds to deallocate network for instance.
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-575052b3-78b6-46ee-95b8-0fdd87b91ce9 req-50bd8a5e-491d-4150-af7a-7af5749fee6d service nova] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Received event network-vif-deleted-08c2128c-77ab-47c8-a1a4-5ef5efaee1c2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088353.9302099, cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:19:13 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] VM Resumed (Lifecycle Event)
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:19:13 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Instance spawned successfully.
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:13 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:19:13 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088353.9316168, cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:19:13 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] VM Started (Lifecycle Event)
Aug 26 22:19:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:19:14 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:19:14 user nova-compute[72929]: INFO nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Took 8.07 seconds to spawn the instance on the hypervisor.
Aug 26 22:19:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:14 user nova-compute[72929]: INFO nova.compute.manager [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Took 8.83 seconds to build instance.
Aug 26 22:19:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9dd1ed04-d61a-4a12-a88d-e52247328a4d tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.959s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:14 user nova-compute[72929]: INFO nova.compute.manager [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 22:19:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Deleting volume: 48e33df3-6b1c-4ce7-bca3-476fa6ce97b4 {{(pid=72929) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 22:19:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:14 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:19:14 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:19:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:14 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Deleted allocations for instance 21b46025-5ff1-4bf1-a9a0-fd7a1549c705
Aug 26 22:19:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4ae72fed-70e3-469c-92b4-c2b455c1aaac tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "21b46025-5ff1-4bf1-a9a0-fd7a1549c705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.630s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:19:16 user nova-compute[72929]: INFO nova.compute.claims [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Claim successful on node user
Aug 26 22:19:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:19:17 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:19:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG nova.policy [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d285158de464f8ebb394a0cfefa2127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f10fe5a3eb4427936a0e95ffd1f363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:19:17 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Creating image(s)
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "/opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "/opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.207s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk 1073741824" returned: 0 in 0.052s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Successfully created port: 4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Cannot resize image /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Successfully updated port: 4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquired lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-changed-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Refreshing instance network info cache due to event network-changed-4972ab13-0b4f-4a7a-a31b-b6784886f462. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] Acquiring lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:19:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.network.neutron [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updating instance_info_cache with network_info: [{"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Releasing lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Instance network_info: |[{"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] Acquired lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Refreshing network info cache for port 4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Start _get_guest_xml network_info=[{"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:19:19 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:19:19 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:19:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6058937',id=39,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1RQ7vanAxKMB2nUQLwvdLNJhPKUi2pdH2ghmI1RvzRbqr5BEuWVa0mZVyIDjOTr4bTfVcWut8+3DY8FEeInBjWRTkE44Kfk0YiuHaoSRi2IjylRelg9YH82/jadtNktg==',key_name='tempest-keypair-918265696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43f10fe5a3eb4427936a0e95ffd1f363',ramdisk_id='',reservation_id='r-g8tzznqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-89857454',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d285158de464f8ebb394a0cfefa2127',uuid=b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Converting VIF {"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:19:19 user nova-compute[72929]:   <uuid>b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9</uuid>
Aug 26 22:19:19 user nova-compute[72929]:   <name>instance-00000027</name>
Aug 26 22:19:19 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:19:19 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:19:19 user nova-compute[72929]:   <metadata>
Aug 26 22:19:19 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:19:19 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:19:19 user nova-compute[72929]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770</nova:name>
Aug 26 22:19:19 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:19:19</nova:creationTime>
Aug 26 22:19:19 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:19:19 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:19:19 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:19:19 user nova-compute[72929]:       <nova:owner>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:user uuid="5d285158de464f8ebb394a0cfefa2127">tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member</nova:user>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:project uuid="43f10fe5a3eb4427936a0e95ffd1f363">tempest-TestServerVolumeAttachScenarioOldVersion-89857454</nova:project>
Aug 26 22:19:19 user nova-compute[72929]:       </nova:owner>
Aug 26 22:19:19 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:19:19 user nova-compute[72929]:       <nova:ports>
Aug 26 22:19:19 user nova-compute[72929]:         <nova:port uuid="4972ab13-0b4f-4a7a-a31b-b6784886f462">
Aug 26 22:19:19 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 26 22:19:19 user nova-compute[72929]:         </nova:port>
Aug 26 22:19:19 user nova-compute[72929]:       </nova:ports>
Aug 26 22:19:19 user nova-compute[72929]:     </nova:instance>
Aug 26 22:19:19 user nova-compute[72929]:   </metadata>
Aug 26 22:19:19 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:19:19 user nova-compute[72929]:     <system>
Aug 26 22:19:19 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:19:19 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:19:19 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:19:19 user nova-compute[72929]:       <entry name="serial">b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9</entry>
Aug 26 22:19:19 user nova-compute[72929]:       <entry name="uuid">b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9</entry>
Aug 26 22:19:19 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:19:19 user nova-compute[72929]:     </system>
Aug 26 22:19:19 user nova-compute[72929]:   </sysinfo>
Aug 26 22:19:19 user nova-compute[72929]:   <os>
Aug 26 22:19:19 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:19:19 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:19:19 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:19:19 user nova-compute[72929]:   </os>
Aug 26 22:19:19 user nova-compute[72929]:   <features>
Aug 26 22:19:19 user nova-compute[72929]:     <acpi/>
Aug 26 22:19:19 user nova-compute[72929]:     <apic/>
Aug 26 22:19:19 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:19:19 user nova-compute[72929]:   </features>
Aug 26 22:19:19 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:19:19 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:19:19 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:19:19 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:19:19 user nova-compute[72929]:   </clock>
Aug 26 22:19:19 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:19:19 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:19:19 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:19:19 user nova-compute[72929]:   </cpu>
Aug 26 22:19:19 user nova-compute[72929]:   <devices>
Aug 26 22:19:19 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:19:19 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:19:19 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk"/>
Aug 26 22:19:19 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:19:19 user nova-compute[72929]:     </disk>
Aug 26 22:19:19 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:19:19 user nova-compute[72929]:       <mac address="fa:16:3e:b7:8b:ce"/>
Aug 26 22:19:19 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:19:19 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:19:19 user nova-compute[72929]:       <target dev="tap4972ab13-0b"/>
Aug 26 22:19:19 user nova-compute[72929]:     </interface>
Aug 26 22:19:19 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:19:19 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/console.log" append="off"/>
Aug 26 22:19:19 user nova-compute[72929]:     </serial>
Aug 26 22:19:19 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:19:19 user nova-compute[72929]:     <video>
Aug 26 22:19:19 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:19:19 user nova-compute[72929]:     </video>
Aug 26 22:19:19 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:19:19 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:19:19 user nova-compute[72929]:     </rng>
Aug 26 22:19:19 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:19:19 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:19:19 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:19:19 user nova-compute[72929]:     </memballoon>
Aug 26 22:19:19 user nova-compute[72929]:   </devices>
Aug 26 22:19:19 user nova-compute[72929]: </domain>
Aug 26 22:19:19 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:19:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6058937',id=39,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1RQ7vanAxKMB2nUQLwvdLNJhPKUi2pdH2ghmI1RvzRbqr5BEuWVa0mZVyIDjOTr4bTfVcWut8+3DY8FEeInBjWRTkE44Kfk0YiuHaoSRi2IjylRelg9YH82/jadtNktg==',key_name='tempest-keypair-918265696',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43f10fe5a3eb4427936a0e95ffd1f363',ramdisk_id='',reservation_id='r-g8tzznqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-89857454',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d285158de464f8ebb394a0cfefa2127',uuid=b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Converting VIF {"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG os_vif [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4972ab13-0b, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4972ab13-0b, col_values=(('external_ids', {'iface-id': '4972ab13-0b4f-4a7a-a31b-b6784886f462', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:8b:ce', 'vm-uuid': 'b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:19 user nova-compute[72929]: INFO os_vif [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b')
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:19:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] No VIF found with MAC fa:16:3e:b7:8b:ce, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:19:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updated VIF entry in instance network info cache for port 4972ab13-0b4f-4a7a-a31b-b6784886f462. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:19:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updating instance_info_cache with network_info: [{"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71b62092-8ec6-4d59-99e3-adb2ab127f86 req-4da29825-6ebd-4d0a-b268-8b94f6ca0606 service nova] Releasing lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:19:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-24fa18d9-f8b0-44e1-86dc-7b467bb763cf req-99e2d482-c7c3-45de-a3b2-413d91e205c6 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-24fa18d9-f8b0-44e1-86dc-7b467bb763cf req-99e2d482-c7c3-45de-a3b2-413d91e205c6 service nova] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-24fa18d9-f8b0-44e1-86dc-7b467bb763cf req-99e2d482-c7c3-45de-a3b2-413d91e205c6 service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-24fa18d9-f8b0-44e1-86dc-7b467bb763cf req-99e2d482-c7c3-45de-a3b2-413d91e205c6 service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-24fa18d9-f8b0-44e1-86dc-7b467bb763cf req-99e2d482-c7c3-45de-a3b2-413d91e205c6 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] No waiting events found dispatching network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:21 user nova-compute[72929]: WARNING nova.compute.manager [req-24fa18d9-f8b0-44e1-86dc-7b467bb763cf req-99e2d482-c7c3-45de-a3b2-413d91e205c6 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received unexpected event network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 for instance with vm_state building and task_state spawning.
Aug 26 22:19:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088363.238222, b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] VM Resumed (Lifecycle Event)
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Instance spawned successfully.
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088363.239645, b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] VM Started (Lifecycle Event)
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-d256306b-0f7d-4e88-8de0-ed9b259b8f6d req-279afd71-94ef-4016-a8bb-eabd144468c4 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d256306b-0f7d-4e88-8de0-ed9b259b8f6d req-279afd71-94ef-4016-a8bb-eabd144468c4 service nova] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d256306b-0f7d-4e88-8de0-ed9b259b8f6d req-279afd71-94ef-4016-a8bb-eabd144468c4 service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d256306b-0f7d-4e88-8de0-ed9b259b8f6d req-279afd71-94ef-4016-a8bb-eabd144468c4 service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-d256306b-0f7d-4e88-8de0-ed9b259b8f6d req-279afd71-94ef-4016-a8bb-eabd144468c4 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] No waiting events found dispatching network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:23 user nova-compute[72929]: WARNING nova.compute.manager [req-d256306b-0f7d-4e88-8de0-ed9b259b8f6d req-279afd71-94ef-4016-a8bb-eabd144468c4 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received unexpected event network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 for instance with vm_state building and task_state spawning.
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 26 22:19:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:23 user nova-compute[72929]: INFO nova.compute.manager [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Took 6.81 seconds to build instance.
Aug 26 22:19:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d0813acd-ddcd-4104-89e3-92c9c8e5a3c4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.954s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:26 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088351.8011441, 21b46025-5ff1-4bf1-a9a0-fd7a1549c705 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:19:26 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] VM Stopped (Lifecycle Event)
Aug 26 22:19:26 user nova-compute[72929]: DEBUG nova.compute.manager [None req-8cb55e95-57ed-4a23-b075-9fc45f4fb66e None None] [instance: 21b46025-5ff1-4bf1-a9a0-fd7a1549c705] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:31 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:33 user nova-compute[72929]: INFO nova.compute.manager [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Terminating instance
Aug 26 22:19:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-34ee1e87-89d7-47d2-b07b-1b20e5954237 req-6c351b4f-f536-41da-a8fa-f9d39655da07 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-vif-unplugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-34ee1e87-89d7-47d2-b07b-1b20e5954237 req-6c351b4f-f536-41da-a8fa-f9d39655da07 service nova] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-34ee1e87-89d7-47d2-b07b-1b20e5954237 req-6c351b4f-f536-41da-a8fa-f9d39655da07 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-34ee1e87-89d7-47d2-b07b-1b20e5954237 req-6c351b4f-f536-41da-a8fa-f9d39655da07 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-34ee1e87-89d7-47d2-b07b-1b20e5954237 req-6c351b4f-f536-41da-a8fa-f9d39655da07 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] No waiting events found dispatching network-vif-unplugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-34ee1e87-89d7-47d2-b07b-1b20e5954237 req-6c351b4f-f536-41da-a8fa-f9d39655da07 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-vif-unplugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:19:34 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Instance destroyed successfully.
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.objects.instance [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'resources' on Instance uuid fd304c02-bd28-485d-8783-f00dd52c95f0 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-31810582',display_name='tempest-TestVolumeBootPattern-server-31810582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-31810582',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-88arzd59',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:18:13Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=fd304c02-bd28-485d-8783-f00dd52c95f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "address": "fa:16:3e:fe:be:ad", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c69905-5a", "ovs_interfaceid": "64c69905-5aaf-4bca-b3b9-dd5de44ab9d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_vif [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c69905-5a, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:34 user nova-compute[72929]: INFO os_vif [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:be:ad,bridge_name='br-int',has_traffic_filtering=True,id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c69905-5a')
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPQDAXNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:19:34 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b13b93e-f86f-4116-b988-695b70dc78ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[50920604-cd7a-458c-a34d-f08694175a14]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:19:34 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:19:34 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:19:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:19:34 user nova-compute[72929]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba (non-flash)
Aug 26 22:19:34 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:19:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804d7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba'): ({'sdf'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Removing single pathed devices sdf {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed721c96-05de-4ede-a180-082766a1a494]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[206565a8-6f2e-4924-9ce6-9ffba7dce22c]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flushing IO for device /dev/sdf {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e489b-6a58-4117-ad86-7e14a8c19a1c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc223745-fdb2-45c9-a104-6a457664e407]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_cbc5254', '/dev/disk/by-id/scsi-23463663763346630', '/dev/disk/by-id/scsi-1SCST_BIOcbc5254-4cf7c4f09035e123') {{(pid=84150) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb4364b-a503-4463-b90b-2283d30a506d]: (4, None) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20ebcf9-f8c9-4e6f-8f0b-a40376fd20ed]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ddaf21-fe6f-468a-96bc-6c08260ec6ba]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260]
Aug 26 22:19:35 user nova-compute[72929]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba, portal: 172.16.0.220,3260] successful.
Aug 26 22:19:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e111a8e1-ddf8-4c64-8c10-5bc75122ccba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3531334-2f1a-4faf-9192-1bc6386368ee]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== disconnect_volume: return (342ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:19:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Deleting instance files /opt/stack/data/nova/instances/fd304c02-bd28-485d-8783-f00dd52c95f0_del
Aug 26 22:19:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Deletion of /opt/stack/data/nova/instances/fd304c02-bd28-485d-8783-f00dd52c95f0_del complete
Aug 26 22:19:35 user nova-compute[72929]: INFO nova.compute.manager [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-43901b74-a0a4-4537-ae9a-0ce679446270 req-14f26698-2665-4bf6-925e-f6e7ff192ed8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-vif-deleted-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:35 user nova-compute[72929]: INFO nova.compute.manager [req-43901b74-a0a4-4537-ae9a-0ce679446270 req-14f26698-2665-4bf6-925e-f6e7ff192ed8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Neutron deleted interface 64c69905-5aaf-4bca-b3b9-dd5de44ab9d2; detaching it from the instance and deleting it from the info cache
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.network.neutron [req-43901b74-a0a4-4537-ae9a-0ce679446270 req-14f26698-2665-4bf6-925e-f6e7ff192ed8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:19:35 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Took 0.60 seconds to deallocate network for instance.
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-43901b74-a0a4-4537-ae9a-0ce679446270 req-14f26698-2665-4bf6-925e-f6e7ff192ed8 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Detach interface failed, port_id=64c69905-5aaf-4bca-b3b9-dd5de44ab9d2, reason: Instance fd304c02-bd28-485d-8783-f00dd52c95f0 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-2e006342-493b-4149-9728-3ef77b00e7a9 req-08e97561-5a56-4bf9-8c1e-75f4bd4a2cf3 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received event network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2e006342-493b-4149-9728-3ef77b00e7a9 req-08e97561-5a56-4bf9-8c1e-75f4bd4a2cf3 service nova] Acquiring lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2e006342-493b-4149-9728-3ef77b00e7a9 req-08e97561-5a56-4bf9-8c1e-75f4bd4a2cf3 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2e006342-493b-4149-9728-3ef77b00e7a9 req-08e97561-5a56-4bf9-8c1e-75f4bd4a2cf3 service nova] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-2e006342-493b-4149-9728-3ef77b00e7a9 req-08e97561-5a56-4bf9-8c1e-75f4bd4a2cf3 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] No waiting events found dispatching network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:19:36 user nova-compute[72929]: WARNING nova.compute.manager [req-2e006342-493b-4149-9728-3ef77b00e7a9 req-08e97561-5a56-4bf9-8c1e-75f4bd4a2cf3 service nova] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Received unexpected event network-vif-plugged-64c69905-5aaf-4bca-b3b9-dd5de44ab9d2 for instance with vm_state active and task_state deleting.
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:36 user nova-compute[72929]: INFO nova.compute.manager [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Took 0.97 seconds to detach 1 volumes for instance.
Aug 26 22:19:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Deleting volume: e111a8e1-ddf8-4c64-8c10-5bc75122ccba {{(pid=72929) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:37 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid 'fd304c02-bd28-485d-8783-f00dd52c95f0' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid 'fd304c02-bd28-485d-8783-f00dd52c95f0' (instance-00000025)
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:37 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Deleted allocations for instance fd304c02-bd28-485d-8783-f00dd52c95f0
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-092851dc-b9ad-494d-a941-50ad953eee6f tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "fd304c02-bd28-485d-8783-f00dd52c95f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.491s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:19:37 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:19:37 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:19:37 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=24.020401000976562GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:19:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance c1608933-05ed-4314-a13b-a48035aa841b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:19:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:49 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088374.6779556, fd304c02-bd28-485d-8783-f00dd52c95f0 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:19:49 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] VM Stopped (Lifecycle Event)
Aug 26 22:19:49 user nova-compute[72929]: DEBUG nova.compute.manager [None req-00cd0b12-ab73-457f-8566-409b11ac4807 None None] [instance: fd304c02-bd28-485d-8783-f00dd52c95f0] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:19:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:19:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "c1608933-05ed-4314-a13b-a48035aa841b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:07 user nova-compute[72929]: INFO nova.compute.manager [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Terminating instance
Aug 26 22:20:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-faca9173-8049-426d-b701-59ab5f3de2ea req-51637201-a123-4c40-9896-3f55ef62a633 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-vif-unplugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-faca9173-8049-426d-b701-59ab5f3de2ea req-51637201-a123-4c40-9896-3f55ef62a633 service nova] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-faca9173-8049-426d-b701-59ab5f3de2ea req-51637201-a123-4c40-9896-3f55ef62a633 service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-faca9173-8049-426d-b701-59ab5f3de2ea req-51637201-a123-4c40-9896-3f55ef62a633 service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-faca9173-8049-426d-b701-59ab5f3de2ea req-51637201-a123-4c40-9896-3f55ef62a633 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] No waiting events found dispatching network-vif-unplugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-faca9173-8049-426d-b701-59ab5f3de2ea req-51637201-a123-4c40-9896-3f55ef62a633 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-vif-unplugged-8c43ee94-0853-4850-95f1-3f889602ec01 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:20:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Instance destroyed successfully.
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lazy-loading 'resources' on Instance uuid c1608933-05ed-4314-a13b-a48035aa841b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1642304118',display_name='tempest-ServerActionsTestOtherA-server-1642304118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1642304118',id=14,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkhJ/Rat39bwd/jR6gHVC4rujpUeoE9YfLx3/MU/fSkR91nV1KNrMXRrlnHzfOXm2PEoXdoUwD4P/RVG1bDNf7mIejUds6wvmQG93hqbxryT+Sk9CL5EoFtohYcO5y4Tw==',key_name='tempest-keypair-69811177',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:00:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4e6cde0e448142e48abb9220470391f2',ramdisk_id='',reservation_id='r-1nlxy90r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1951554093',owner_user_name='tempest-ServerActionsTestOtherA-1951554093-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:00:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93c597a2c99646f1bb79645380ce0b75',uuid=c1608933-05ed-4314-a13b-a48035aa841b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converting VIF {"id": "8c43ee94-0853-4850-95f1-3f889602ec01", "address": "fa:16:3e:c6:4d:d3", "network": {"id": "5fcb3f00-629c-4bdf-9570-bbf5ffa471c4", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1870601805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4e6cde0e448142e48abb9220470391f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c43ee94-08", "ovs_interfaceid": "8c43ee94-0853-4850-95f1-3f889602ec01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG os_vif [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c43ee94-08, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:20:08 user nova-compute[72929]: INFO os_vif [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:4d:d3,bridge_name='br-int',has_traffic_filtering=True,id=8c43ee94-0853-4850-95f1-3f889602ec01,network=Network(5fcb3f00-629c-4bdf-9570-bbf5ffa471c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c43ee94-08')
Aug 26 22:20:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Deleting instance files /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b_del
Aug 26 22:20:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Deletion of /opt/stack/data/nova/instances/c1608933-05ed-4314-a13b-a48035aa841b_del complete
Aug 26 22:20:08 user nova-compute[72929]: INFO nova.compute.manager [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 22:20:08 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:08 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Took 0.51 seconds to deallocate network for instance.
Aug 26 22:20:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:20:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:09 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Deleted allocations for instance c1608933-05ed-4314-a13b-a48035aa841b
Aug 26 22:20:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e0ec5f29-40a3-4e94-bbf3-2d8d0d8b8e93 tempest-ServerActionsTestOtherA-1951554093 tempest-ServerActionsTestOtherA-1951554093-project-member] Lock "c1608933-05ed-4314-a13b-a48035aa841b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.767s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] Acquiring lock "c1608933-05ed-4314-a13b-a48035aa841b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] Lock "c1608933-05ed-4314-a13b-a48035aa841b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] No waiting events found dispatching network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:09 user nova-compute[72929]: WARNING nova.compute.manager [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received unexpected event network-vif-plugged-8c43ee94-0853-4850-95f1-3f889602ec01 for instance with vm_state deleted and task_state None.
Aug 26 22:20:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f883bfa9-e48a-4409-9bac-aece0b2cb10b req-fdba035b-df6e-4bb7-b19a-da04c7923a25 service nova] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Received event network-vif-deleted-8c43ee94-0853-4850-95f1-3f889602ec01 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:15 user nova-compute[72929]: INFO nova.compute.manager [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Unshelving
Aug 26 22:20:15 user nova-compute[72929]: INFO nova.virt.block_device [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Booting with volume 008a85d8-b5e2-40f3-9fad-916b78c4044a at /dev/vda
Aug 26 22:20:15 user nova-compute[72929]: DEBUG os_brick.utils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[77662739-bd9b-432e-ad70-abdaa331a082]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4cf0cc-d134-4810-9a93-66f75d5bd866]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f352d867-a420-408a-9889-3a845fa209df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3996cd7-0d3a-4ad9-abef-c75498c5f418]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:20:15 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:20:15 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d602131e-b3ef-4e80-8ce8-81f7983cc93b]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG os_brick.utils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:20:15 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating existing volume attachment record: 87ea6b10-3070-4bde-b232-54164120c6fc {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:20:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:20:18 user nova-compute[72929]: INFO nova.compute.manager [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Unrescuing
Aug 26 22:20:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'flavor' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-c1d5fba6-8b32-4459-ad4b-0c09a0ed5a0a req-12f13166-e378-45cb-9d98-61f359193da4 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1d5fba6-8b32-4459-ad4b-0c09a0ed5a0a req-12f13166-e378-45cb-9d98-61f359193da4 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1d5fba6-8b32-4459-ad4b-0c09a0ed5a0a req-12f13166-e378-45cb-9d98-61f359193da4 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c1d5fba6-8b32-4459-ad4b-0c09a0ed5a0a req-12f13166-e378-45cb-9d98-61f359193da4 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-c1d5fba6-8b32-4459-ad4b-0c09a0ed5a0a req-12f13166-e378-45cb-9d98-61f359193da4 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:19 user nova-compute[72929]: WARNING nova.compute.manager [req-c1d5fba6-8b32-4459-ad4b-0c09a0ed5a0a req-12f13166-e378-45cb-9d98-61f359193da4 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:20:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:20 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance destroyed successfully.
Aug 26 22:20:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:21 user nova-compute[72929]: WARNING nova.compute.manager [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:21 user nova-compute[72929]: WARNING nova.compute.manager [req-23a818b7-2032-4ad1-8211-ed30a59d0220 req-db418b1f-110b-459f-a663-0486fc4cde7a service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state rescued and task_state unrescuing.
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing instance network info cache due to event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:21 user nova-compute[72929]: DEBUG nova.network.neutron [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updated VIF entry in instance network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-9a83e18f-6311-4e81-aa6c-e3477929629a req-ac369a69-dd76-40d9-ad45-56d12e23ec2d service nova] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing instance network info cache due to event network-changed-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Refreshing network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088408.092507, c1608933-05ed-4314-a13b-a48035aa841b => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: c1608933-05ed-4314-a13b-a48035aa841b] VM Stopped (Lifecycle Event)
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d1a319a4-1e95-4939-ae16-9c00c45ef23a None None] [instance: c1608933-05ed-4314-a13b-a48035aa841b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.compute.manager [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Detaching volume ad8fc906-dc32-4dc7-ad1f-2080c5621d00
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.virt.block_device [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Attempting to driver detach volume ad8fc906-dc32-4dc7-ad1f-2080c5621d00 from mountpoint /dev/vdb
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Attempting to detach device vdb from instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:20:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:20:23 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:20:23 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:20:23 user nova-compute[72929]:   <serial>ad8fc906-dc32-4dc7-ad1f-2080c5621d00</serial>
Aug 26 22:20:23 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:20:23 user nova-compute[72929]: </disk>
Aug 26 22:20:23 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully detached device vdb from instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 from the persistent domain config.
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:20:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:20:23 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:20:23 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:20:23 user nova-compute[72929]:   <serial>ad8fc906-dc32-4dc7-ad1f-2080c5621d00</serial>
Aug 26 22:20:23 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 26 22:20:23 user nova-compute[72929]: </disk>
Aug 26 22:20:23 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.network.neutron [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updated VIF entry in instance network info cache for port 3632a0dc-897c-4f27-b6f8-ac192c6fbcf1. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.network.neutron [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-931f8866-59a4-45f9-8755-ff17a2a18680 req-9116a588-5435-4bfc-8a9d-6fb18c721f76 service nova] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088423.7047012, 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088423.7076788, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Resumed (Lifecycle Event)
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b61a5b09-be9f-4a64-bc86-03d9ccee8b8c tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully detached device vdb from instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 from the live domain config.
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JIbnPUiY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:20:23 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e264da6-4644-40d6-892f-17a140fb9851]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088423.7108986, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:20:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Started (Lifecycle Event)
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5426915a-e674-4e68-a5dd-47c60e3ae216]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:20:23 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:20:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:20:23 user nova-compute[72929]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 (non-flash)
Aug 26 22:20:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8018a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d443c399-a520-4489-98f8-657397c55461]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-25954d01-ac7f-40cb-8553-f0041f8a97be req-6c7cce80-4a55-4be0-937f-fb5efc246b18 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-25954d01-ac7f-40cb-8553-f0041f8a97be req-6c7cce80-4a55-4be0-937f-fb5efc246b18 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-25954d01-ac7f-40cb-8553-f0041f8a97be req-6c7cce80-4a55-4be0-937f-fb5efc246b18 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-25954d01-ac7f-40cb-8553-f0041f8a97be req-6c7cce80-4a55-4be0-937f-fb5efc246b18 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-25954d01-ac7f-40cb-8553-f0041f8a97be req-6c7cce80-4a55-4be0-937f-fb5efc246b18 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:23 user nova-compute[72929]: WARNING nova.compute.manager [req-25954d01-ac7f-40cb-8553-f0041f8a97be req-6c7cce80-4a55-4be0-937f-fb5efc246b18 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state None.
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[785feabe-7c6f-44dd-b50d-4b8f500ed72c]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7467a4d5-f7da-488d-ad4d-0e28fb45f87a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[02341147-7a9e-4e10-812f-2864ad89b21c]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30a7967-e85f-45cd-9a5e-8a093c90b911]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7fc0e3-8e76-49fc-83ee-537fa356b1fb]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260]
Aug 26 22:20:23 user nova-compute[72929]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00, portal: 172.16.0.220,3260] successful.
Aug 26 22:20:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad8fc906-dc32-4dc7-ad1f-2080c5621d00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5463e0-ea1f-4a2b-8abd-e5099b5eba2c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== disconnect_volume: return (285ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG nova.objects.instance [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'flavor' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-78824b85-e97d-4f1f-b1cb-38253f799c4b tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'pci_requests' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'numa_topology' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:20:27 user nova-compute[72929]: INFO nova.compute.claims [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Claim successful on node user
Aug 26 22:20:27 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:20:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.358s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:27 user nova-compute[72929]: INFO nova.network.neutron [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating port fcda8100-bab8-4241-b6d2-b0be62aec358 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.compute.manager [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing instance network info cache due to event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:20:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Creating image(s)
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Ensure instance console log exists: /opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Start _get_guest_xml network_info=[{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '87ea6b10-3070-4bde-b232-54164120c6fc', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1b278bf0-b061-48a8-86e2-c1f7680bd6e4', 'attached_at': '', 'detached_at': '', 'volume_id': '008a85d8-b5e2-40f3-9fad-916b78c4044a', 'serial': '008a85d8-b5e2-40f3-9fad-916b78c4044a'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.network.neutron [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:20:28 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:20:28 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.objects.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Object Instance<1b278bf0-b061-48a8-86e2-c1f7680bd6e4> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:20:28 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:20:28 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:20:28 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3496784-af8d-47bb-a6a5-adefab0c37a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:20:28 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b422ec48-520b-4852-9d67-1f5659ff6427]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a] added
Aug 26 22:20:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e1508-848c-4165-b8e1-5f75508db2d4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d097435-fb88-4e03-929f-c62aadcae7d0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTEGpafH {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YTEGpafH" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a268c2c3-870e-405e-b12b-7fc73cd41de9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YTEGpafH'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d98b8-7833-4cc5-b956-c2bdfb096391]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a647fc9-79e1-4ab3-b32d-20057220110a]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:20:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:20:28 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:20:28 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ce4dfc-2b75-47ec-a310-86541bfe11cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]
Aug 26 22:20:29 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.
Aug 26 22:20:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4071e6b-17d2-4f17-bdf0-a2ce523e00e1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4707dd-2680-43ab-91e1-a2ebc9bb95e4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:20:29 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:20:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:20:29 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:20:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe234cb-e5d5-46e0-9b6c-d87665c913ec]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updated VIF entry in instance network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1859eb8d-df02-46da-9aa0-f6f4053d244f req-c48e02d8-a176-441b-b044-ef4718c9f2d8 service nova] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23437323931666532', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437323931666532', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-921211666',display_name='tempest-TestShelveInstance-server-921211666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-921211666',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1482362583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='48d5337fa05b4872a0589f369a799195',ramdisk_id='',reservation_id='r-oj2wastp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1331467690',owner_user_name='tempest-TestShelveInstance-1331467690-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:20:16Z,user_data=None,user_id='814a67adaa1c4fdea167130c337403ef',uuid=1b278bf0-b061-48a8-86e2-c1f7680bd6e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converting VIF {"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.objects.base [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Object Instance<1b278bf0-b061-48a8-86e2-c1f7680bd6e4> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:20:30 user nova-compute[72929]:   <uuid>1b278bf0-b061-48a8-86e2-c1f7680bd6e4</uuid>
Aug 26 22:20:30 user nova-compute[72929]:   <name>instance-00000023</name>
Aug 26 22:20:30 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:20:30 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:20:30 user nova-compute[72929]:   <metadata>
Aug 26 22:20:30 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:20:30 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:20:30 user nova-compute[72929]:       <nova:name>tempest-TestShelveInstance-server-921211666</nova:name>
Aug 26 22:20:30 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:20:28</nova:creationTime>
Aug 26 22:20:30 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:20:30 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:20:30 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:20:30 user nova-compute[72929]:       <nova:owner>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:user uuid="814a67adaa1c4fdea167130c337403ef">tempest-TestShelveInstance-1331467690-project-member</nova:user>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:project uuid="48d5337fa05b4872a0589f369a799195">tempest-TestShelveInstance-1331467690</nova:project>
Aug 26 22:20:30 user nova-compute[72929]:       </nova:owner>
Aug 26 22:20:30 user nova-compute[72929]:       <nova:ports>
Aug 26 22:20:30 user nova-compute[72929]:         <nova:port uuid="fcda8100-bab8-4241-b6d2-b0be62aec358">
Aug 26 22:20:30 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 22:20:30 user nova-compute[72929]:         </nova:port>
Aug 26 22:20:30 user nova-compute[72929]:       </nova:ports>
Aug 26 22:20:30 user nova-compute[72929]:     </nova:instance>
Aug 26 22:20:30 user nova-compute[72929]:   </metadata>
Aug 26 22:20:30 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:20:30 user nova-compute[72929]:     <system>
Aug 26 22:20:30 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:20:30 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:20:30 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:20:30 user nova-compute[72929]:       <entry name="serial">1b278bf0-b061-48a8-86e2-c1f7680bd6e4</entry>
Aug 26 22:20:30 user nova-compute[72929]:       <entry name="uuid">1b278bf0-b061-48a8-86e2-c1f7680bd6e4</entry>
Aug 26 22:20:30 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:20:30 user nova-compute[72929]:     </system>
Aug 26 22:20:30 user nova-compute[72929]:   </sysinfo>
Aug 26 22:20:30 user nova-compute[72929]:   <os>
Aug 26 22:20:30 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:20:30 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:20:30 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:20:30 user nova-compute[72929]:   </os>
Aug 26 22:20:30 user nova-compute[72929]:   <features>
Aug 26 22:20:30 user nova-compute[72929]:     <acpi/>
Aug 26 22:20:30 user nova-compute[72929]:     <apic/>
Aug 26 22:20:30 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:20:30 user nova-compute[72929]:   </features>
Aug 26 22:20:30 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:20:30 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:20:30 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:20:30 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:20:30 user nova-compute[72929]:   </clock>
Aug 26 22:20:30 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:20:30 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:20:30 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:20:30 user nova-compute[72929]:   </cpu>
Aug 26 22:20:30 user nova-compute[72929]:   <devices>
Aug 26 22:20:30 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:20:30 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:20:30 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:20:30 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:20:30 user nova-compute[72929]:       <serial>008a85d8-b5e2-40f3-9fad-916b78c4044a</serial>
Aug 26 22:20:30 user nova-compute[72929]:     </disk>
Aug 26 22:20:30 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:20:30 user nova-compute[72929]:       <mac address="fa:16:3e:e8:9f:ea"/>
Aug 26 22:20:30 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:20:30 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:20:30 user nova-compute[72929]:       <target dev="tapfcda8100-ba"/>
Aug 26 22:20:30 user nova-compute[72929]:     </interface>
Aug 26 22:20:30 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:20:30 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4/console.log" append="off"/>
Aug 26 22:20:30 user nova-compute[72929]:     </serial>
Aug 26 22:20:30 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:20:30 user nova-compute[72929]:     <video>
Aug 26 22:20:30 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:20:30 user nova-compute[72929]:     </video>
Aug 26 22:20:30 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:20:30 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:20:30 user nova-compute[72929]:     </rng>
Aug 26 22:20:30 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:20:30 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:20:30 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:20:30 user nova-compute[72929]:     </memballoon>
Aug 26 22:20:30 user nova-compute[72929]:   </devices>
Aug 26 22:20:30 user nova-compute[72929]: </domain>
Aug 26 22:20:30 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-921211666',display_name='tempest-TestShelveInstance-server-921211666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-921211666',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1482362583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='48d5337fa05b4872a0589f369a799195',ramdisk_id='',reservation_id='r-oj2wastp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1331467690',owner_user_name='tempest-TestShelveInstance-1331467690-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:20:16Z,user_data=None,user_id='814a67adaa1c4fdea167130c337403ef',uuid=1b278bf0-b061-48a8-86e2-c1f7680bd6e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converting VIF {"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG os_vif [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcda8100-ba, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfcda8100-ba, col_values=(('external_ids', {'iface-id': 'fcda8100-bab8-4241-b6d2-b0be62aec358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:9f:ea', 'vm-uuid': '1b278bf0-b061-48a8-86e2-c1f7680bd6e4'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:30 user nova-compute[72929]: INFO os_vif [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba')
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:20:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] No VIF found with MAC fa:16:3e:e8:9f:ea, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-db97be6a-9b93-4d5e-9141-dd0e573acc03 req-6daa0618-49aa-4885-b2d4-67b8f81a89ae service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-db97be6a-9b93-4d5e-9141-dd0e573acc03 req-6daa0618-49aa-4885-b2d4-67b8f81a89ae service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-db97be6a-9b93-4d5e-9141-dd0e573acc03 req-6daa0618-49aa-4885-b2d4-67b8f81a89ae service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-db97be6a-9b93-4d5e-9141-dd0e573acc03 req-6daa0618-49aa-4885-b2d4-67b8f81a89ae service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-db97be6a-9b93-4d5e-9141-dd0e573acc03 req-6daa0618-49aa-4885-b2d4-67b8f81a89ae service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:31 user nova-compute[72929]: WARNING nova.compute.manager [req-db97be6a-9b93-4d5e-9141-dd0e573acc03 req-6daa0618-49aa-4885-b2d4-67b8f81a89ae service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 26 22:20:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088433.57308, 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:20:33 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] VM Resumed (Lifecycle Event)
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:20:33 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance spawned successfully.
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:20:33 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088433.5746844, 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:20:33 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] VM Started (Lifecycle Event)
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c4ed9126-a9bf-41ee-807e-67baba5e3639 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.086s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-674ed286-46ef-4352-b139-e70f4c443638 req-27a54ea3-1980-4f7d-89ef-8abc0e517895 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-674ed286-46ef-4352-b139-e70f4c443638 req-27a54ea3-1980-4f7d-89ef-8abc0e517895 service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-674ed286-46ef-4352-b139-e70f4c443638 req-27a54ea3-1980-4f7d-89ef-8abc0e517895 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-674ed286-46ef-4352-b139-e70f4c443638 req-27a54ea3-1980-4f7d-89ef-8abc0e517895 service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-674ed286-46ef-4352-b139-e70f4c443638 req-27a54ea3-1980-4f7d-89ef-8abc0e517895 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:20:33 user nova-compute[72929]: WARNING nova.compute.manager [req-674ed286-46ef-4352-b139-e70f4c443638 req-27a54ea3-1980-4f7d-89ef-8abc0e517895 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state active and task_state None.
Aug 26 22:20:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [{"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-0c2f1ca8-4e83-4738-8cf3-041685ef8c40" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:20:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:37 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:20:37 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:20:37 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8105MB free_disk=24.017597198486328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:20:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:20:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:20:51 user nova-compute[72929]: INFO nova.compute.claims [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Claim successful on node user
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:20:51 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:20:51 user nova-compute[72929]: INFO nova.virt.block_device [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Booting with volume 91f679b5-012a-4232-a36c-f401f632046c at /dev/vda
Aug 26 22:20:51 user nova-compute[72929]: DEBUG nova.policy [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf31c30629f7485a9b160f8d853096dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6b106b16484bfa8fd629b57527130f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG os_brick.utils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ddbb33-9b85-45ee-9c1b-cbdc2fd08bf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3e6e17-9833-4497-ad83-eab7f167a035]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe538e-2796-45bf-8339-48a593054fb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c49535-53e5-4a42-8d8d-4391ac188834]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:20:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:20:52 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:20:52 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b8c748-fe49-4f32-b8f3-a0b0c8583e44]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG os_brick.utils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updating existing volume attachment record: a583ff81-56ca-4db2-81b1-44d68c864a91 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:20:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Successfully created port: b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Successfully updated port: b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquired lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-changed-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Refreshing instance network info cache due to event network-changed-b8db3359-f80b-4d0e-9ac2-78a9cde67727. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] Acquiring lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updating instance_info_cache with network_info: [{"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Releasing lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Instance network_info: |[{"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] Acquired lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Refreshing network info cache for port b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:20:54 user nova-compute[72929]: DEBUG nova.network.neutron [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updated VIF entry in instance network info cache for port b8db3359-f80b-4d0e-9ac2-78a9cde67727. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:20:54 user nova-compute[72929]: DEBUG nova.network.neutron [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updating instance_info_cache with network_info: [{"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3689708c-e524-49e7-ae27-b83d77f71f88 req-f8da6752-944d-44b6-b8b6-e216909bdfa9 service nova] Releasing lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-changed-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.compute.manager [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Refreshing instance network info cache due to event network-changed-c8e0004f-55ae-4dd7-88ba-95ff1e23cace. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] Acquiring lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] Acquired lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Refreshing network info cache for port c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'flavor' on Instance uuid cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:20:56 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Ignoring supplied device name: /dev/vdb
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:20:56 user nova-compute[72929]: INFO nova.compute.manager [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Attaching volume ced33568-0e2f-4459-94a0-aa7ecba4ca75 to /dev/vdb
Aug 26 22:20:56 user nova-compute[72929]: DEBUG os_brick.utils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1eefd1-a4a0-4ac7-a837-cb1163e54c17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1cd3df-1587-405d-8412-223b1dcf3f7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeeaaf5-5ea2-439c-8884-1c88f42c0714]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34db322-272e-4474-a102-d6bd2f8f7f05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:20:56 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00404c00-37a1-4809-8bda-fa8599c50e19]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG os_brick.utils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updating existing volume attachment record: d1fa8546-bcd7-4604-b00d-795eecd12d21 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updated VIF entry in instance network info cache for port c8e0004f-55ae-4dd7-88ba-95ff1e23cace. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG nova.network.neutron [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updating instance_info_cache with network_info: [{"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:20:56 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f5da7dd7-43ef-4d61-b9dd-be92de86816b req-a1bffc1f-4f2e-4276-80f3-0660febfc30e service nova] Releasing lock "refresh_cache-cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:20:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:21:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Creating image(s)
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Ensure instance console log exists: /opt/stack/data/nova/instances/5be90001-c03f-466e-a8d1-bc167da12cc9/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Start _get_guest_xml network_info=[{"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'a583ff81-56ca-4db2-81b1-44d68c864a91', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCoTXIlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5be90001-c03f-466e-a8d1-bc167da12cc9', 'attached_at': '', 'detached_at': '', 'volume_id': '91f679b5-012a-4232-a36c-f401f632046c', 'serial': '91f679b5-012a-4232-a36c-f401f632046c'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:21:03 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:21:03 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCoTXIlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:21:03 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:03 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:03 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4753f518-4e9a-4f94-8898-930141f4a36a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:21:03 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba98206-06e8-42e3-bdda-809710774e91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c] added
Aug 26 22:21:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b19437-2eb9-4433-a48d-b2d619d49d17]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b80b7e-32cf-4763-8c09-b2b7dad80224]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCoTXIlz {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCoTXIlz" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95c9f0-8441-4966-84b2-baff710b47cd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCoTXIlz'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4eeb8d-d174-4b04-a24b-de18b5448b1d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5c181c-fc26-4ccf-9493-618595b4aa81]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:03 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:03 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8fe179-4596-46ab-a14d-66f20dba7bd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260]
Aug 26 22:21:03 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260] successful.
Aug 26 22:21:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0989fae-4fad-495d-ab5b-90a582254857]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167e8d4-1fd1-4d9b-964d-572239081672]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:03 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:03 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:03 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:03 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e075ea-002f-488e-8ae0-aa5a584b407a]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCoTXIlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:21:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26635613833653761', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635613833653761', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1213688735',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1213688735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1213688735',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc+oJhe4j9t0KtFJp8X2Ba6UfPjWyJcj38VrtK8acNV1gdUWs02mDbm2dw1xUzT3elczHe5doUEii0XXGlxDeRnfleBZhE/0ChfINR/ZeFOYYn+xtIktfykiEwlaFkcrg==',key_name='tempest-keypair-1483115157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-cllywavv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf31c30629f7485a9b160f8d853096dc',uuid=5be90001-c03f-466e-a8d1-bc167da12cc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'pci_devices' on Instance uuid 5be90001-c03f-466e-a8d1-bc167da12cc9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:21:04 user nova-compute[72929]:   <uuid>5be90001-c03f-466e-a8d1-bc167da12cc9</uuid>
Aug 26 22:21:04 user nova-compute[72929]:   <name>instance-00000028</name>
Aug 26 22:21:04 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:21:04 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:21:04 user nova-compute[72929]:   <metadata>
Aug 26 22:21:04 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:21:04 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:21:04 user nova-compute[72929]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1213688735</nova:name>
Aug 26 22:21:04 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:21:03</nova:creationTime>
Aug 26 22:21:04 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:21:04 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:21:04 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:21:04 user nova-compute[72929]:       <nova:owner>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:user uuid="cf31c30629f7485a9b160f8d853096dc">tempest-TestVolumeBootPattern-1716061349-project-member</nova:user>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:project uuid="ea6b106b16484bfa8fd629b57527130f">tempest-TestVolumeBootPattern-1716061349</nova:project>
Aug 26 22:21:04 user nova-compute[72929]:       </nova:owner>
Aug 26 22:21:04 user nova-compute[72929]:       <nova:ports>
Aug 26 22:21:04 user nova-compute[72929]:         <nova:port uuid="b8db3359-f80b-4d0e-9ac2-78a9cde67727">
Aug 26 22:21:04 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 26 22:21:04 user nova-compute[72929]:         </nova:port>
Aug 26 22:21:04 user nova-compute[72929]:       </nova:ports>
Aug 26 22:21:04 user nova-compute[72929]:     </nova:instance>
Aug 26 22:21:04 user nova-compute[72929]:   </metadata>
Aug 26 22:21:04 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:21:04 user nova-compute[72929]:     <system>
Aug 26 22:21:04 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:21:04 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:21:04 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:21:04 user nova-compute[72929]:       <entry name="serial">5be90001-c03f-466e-a8d1-bc167da12cc9</entry>
Aug 26 22:21:04 user nova-compute[72929]:       <entry name="uuid">5be90001-c03f-466e-a8d1-bc167da12cc9</entry>
Aug 26 22:21:04 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:21:04 user nova-compute[72929]:     </system>
Aug 26 22:21:04 user nova-compute[72929]:   </sysinfo>
Aug 26 22:21:04 user nova-compute[72929]:   <os>
Aug 26 22:21:04 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:21:04 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:21:04 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:21:04 user nova-compute[72929]:   </os>
Aug 26 22:21:04 user nova-compute[72929]:   <features>
Aug 26 22:21:04 user nova-compute[72929]:     <acpi/>
Aug 26 22:21:04 user nova-compute[72929]:     <apic/>
Aug 26 22:21:04 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:21:04 user nova-compute[72929]:   </features>
Aug 26 22:21:04 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:21:04 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:21:04 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:21:04 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:21:04 user nova-compute[72929]:   </clock>
Aug 26 22:21:04 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:21:04 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:21:04 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:21:04 user nova-compute[72929]:   </cpu>
Aug 26 22:21:04 user nova-compute[72929]:   <devices>
Aug 26 22:21:04 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:21:04 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:21:04 user nova-compute[72929]:       <source dev="/dev/sdc"/>
Aug 26 22:21:04 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:21:04 user nova-compute[72929]:       <serial>91f679b5-012a-4232-a36c-f401f632046c</serial>
Aug 26 22:21:04 user nova-compute[72929]:     </disk>
Aug 26 22:21:04 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:21:04 user nova-compute[72929]:       <mac address="fa:16:3e:a7:e0:84"/>
Aug 26 22:21:04 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:21:04 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:21:04 user nova-compute[72929]:       <target dev="tapb8db3359-f8"/>
Aug 26 22:21:04 user nova-compute[72929]:     </interface>
Aug 26 22:21:04 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:21:04 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/5be90001-c03f-466e-a8d1-bc167da12cc9/console.log" append="off"/>
Aug 26 22:21:04 user nova-compute[72929]:     </serial>
Aug 26 22:21:04 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:21:04 user nova-compute[72929]:     <video>
Aug 26 22:21:04 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:21:04 user nova-compute[72929]:     </video>
Aug 26 22:21:04 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:21:04 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:21:04 user nova-compute[72929]:     </rng>
Aug 26 22:21:04 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:21:04 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:21:04 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:21:04 user nova-compute[72929]:     </memballoon>
Aug 26 22:21:04 user nova-compute[72929]:   </devices>
Aug 26 22:21:04 user nova-compute[72929]: </domain>
Aug 26 22:21:04 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1213688735',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1213688735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1213688735',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc+oJhe4j9t0KtFJp8X2Ba6UfPjWyJcj38VrtK8acNV1gdUWs02mDbm2dw1xUzT3elczHe5doUEii0XXGlxDeRnfleBZhE/0ChfINR/ZeFOYYn+xtIktfykiEwlaFkcrg==',key_name='tempest-keypair-1483115157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-cllywavv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:20:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf31c30629f7485a9b160f8d853096dc',uuid=5be90001-c03f-466e-a8d1-bc167da12cc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG os_vif [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8db3359-f8, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb8db3359-f8, col_values=(('external_ids', {'iface-id': 'b8db3359-f80b-4d0e-9ac2-78a9cde67727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:e0:84', 'vm-uuid': '5be90001-c03f-466e-a8d1-bc167da12cc9'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:04 user nova-compute[72929]: INFO os_vif [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8')
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:21:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No VIF found with MAC fa:16:3e:a7:e0:84, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-65d074e6-e47d-4552-af34-dbb42e4138ea req-f91ca136-0560-40f9-826c-c181fc057991 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-65d074e6-e47d-4552-af34-dbb42e4138ea req-f91ca136-0560-40f9-826c-c181fc057991 service nova] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-65d074e6-e47d-4552-af34-dbb42e4138ea req-f91ca136-0560-40f9-826c-c181fc057991 service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-65d074e6-e47d-4552-af34-dbb42e4138ea req-f91ca136-0560-40f9-826c-c181fc057991 service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-65d074e6-e47d-4552-af34-dbb42e4138ea req-f91ca136-0560-40f9-826c-c181fc057991 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] No waiting events found dispatching network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:21:06 user nova-compute[72929]: WARNING nova.compute.manager [req-65d074e6-e47d-4552-af34-dbb42e4138ea req-f91ca136-0560-40f9-826c-c181fc057991 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received unexpected event network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 for instance with vm_state building and task_state spawning.
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-changed-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Refreshing instance network info cache due to event network-changed-4972ab13-0b4f-4a7a-a31b-b6784886f462. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] Acquiring lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] Acquired lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Refreshing network info cache for port 4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-3c764d18-df94-4081-8a97-f6ab2d6180f1 req-30588789-4f86-49fc-be99-f33c09dbcdee service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c764d18-df94-4081-8a97-f6ab2d6180f1 req-30588789-4f86-49fc-be99-f33c09dbcdee service nova] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c764d18-df94-4081-8a97-f6ab2d6180f1 req-30588789-4f86-49fc-be99-f33c09dbcdee service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c764d18-df94-4081-8a97-f6ab2d6180f1 req-30588789-4f86-49fc-be99-f33c09dbcdee service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-3c764d18-df94-4081-8a97-f6ab2d6180f1 req-30588789-4f86-49fc-be99-f33c09dbcdee service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] No waiting events found dispatching network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:21:08 user nova-compute[72929]: WARNING nova.compute.manager [req-3c764d18-df94-4081-8a97-f6ab2d6180f1 req-30588789-4f86-49fc-be99-f33c09dbcdee service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received unexpected event network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 for instance with vm_state building and task_state spawning.
Aug 26 22:21:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088468.8139946, 5be90001-c03f-466e-a8d1-bc167da12cc9 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:21:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] VM Resumed (Lifecycle Event)
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:21:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Instance spawned successfully.
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:21:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088468.819859, 5be90001-c03f-466e-a8d1-bc167da12cc9 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:21:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] VM Started (Lifecycle Event)
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:21:08 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:21:08 user nova-compute[72929]: INFO nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updated VIF entry in instance network info cache for port 4972ab13-0b4f-4a7a-a31b-b6784886f462. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:21:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updating instance_info_cache with network_info: [{"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0deecd73-a45b-4555-812f-74e677fd5eff req-bd52d0bc-ba80-43f6-b4b0-e09e336c1c83 service nova] Releasing lock "refresh_cache-b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:21:09 user nova-compute[72929]: INFO nova.compute.manager [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Took 17.73 seconds to build instance.
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e049126d-d76b-46a7-aca2-17f989018a84 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.827s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTRPdNLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:21:09 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:09 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:09 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559e950-15aa-43c6-baa7-3252624a2410]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:21:09 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f132d94-ca15-4339-948c-a9135aac4993]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75] added
Aug 26 22:21:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f67900-65ab-4e7e-84b5-b50a653e116c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708c7c6-c2ad-4823-bb3a-2af2fbbfb3fc]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTRPdNLa {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HTRPdNLa" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a6aa0-1a07-4560-a138-0cc95ffc49e0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HTRPdNLa'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00582c79-641a-4d26-af05-bf2eee8745a1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[41250412-f809-4321-b23d-e0c024b426f6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[241af6ad-ca91-41a3-b899-9089c6b60021]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260]
Aug 26 22:21:09 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260] successful.
Aug 26 22:21:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deed15d-4bd6-4621-b2f0-0a92cceee4f9]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[67903d27-d51d-423b-b93c-cddaaa05f32b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:09 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95a8e4c-5dd4-48e0-99e5-3c69e9caca9c]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:21:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTRPdNLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23534313632663232', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534313632663232', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'flavor' on Instance uuid cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:21:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:21:10 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:21:10 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:21:10 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:21:10 user nova-compute[72929]:   <serial>ced33568-0e2f-4459-94a0-aa7ecba4ca75</serial>
Aug 26 22:21:10 user nova-compute[72929]: </disk>
Aug 26 22:21:10 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:21:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:21:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:21:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No VIF found with MAC fa:16:3e:f1:6a:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:21:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b83e272e-4ce3-4718-8f8a-1284a8d38163 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.703s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lazy-loading 'flavor' on Instance uuid b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:13 user nova-compute[72929]: INFO nova.compute.manager [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Attaching volume 6e574a22-e7d2-47de-8ac0-cee8a2964aa8 to /dev/vdb
Aug 26 22:21:14 user nova-compute[72929]: DEBUG os_brick.utils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cef06-c217-47eb-b2da-881261948b06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[81db3ea2-3b63-47f0-9335-5360153483f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e867b-aa02-45d8-84ee-769a0be3969e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe91cab8-48b6-4c73-99fa-ecddbe86e3e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:21:14 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:21:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ee2815-ce7e-42f5-a9c8-9752116023bb]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG os_brick.utils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updating existing volume attachment record: 31600f13-c5f0-48e8-bf01-9e92a3e7f6e0 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:21:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:21 user nova-compute[72929]: INFO nova.compute.manager [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Terminating instance
Aug 26 22:21:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-eb62bf87-7606-41e8-a5fe-fc946190734b req-821e0343-578d-489d-8d13-35ec2a0d7510 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-unplugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eb62bf87-7606-41e8-a5fe-fc946190734b req-821e0343-578d-489d-8d13-35ec2a0d7510 service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eb62bf87-7606-41e8-a5fe-fc946190734b req-821e0343-578d-489d-8d13-35ec2a0d7510 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-eb62bf87-7606-41e8-a5fe-fc946190734b req-821e0343-578d-489d-8d13-35ec2a0d7510 service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-eb62bf87-7606-41e8-a5fe-fc946190734b req-821e0343-578d-489d-8d13-35ec2a0d7510 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-unplugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:21:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-eb62bf87-7606-41e8-a5fe-fc946190734b req-821e0343-578d-489d-8d13-35ec2a0d7510 service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-unplugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Instance destroyed successfully.
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'resources' on Instance uuid 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-928317325',display_name='tempest-TestMinimumBasicScenario-server-928317325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-928317325',id=34,image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBl2xXUEMZzC+e1K2bZnbtn1r+QqlrEVEH+oUa+u8a0gY5NyM3e4C1L8CcrtE7gR2cy9DqowdK0eCNc1Hza7dw1c8XRLPksEaACWBtjlz0ASN7Na87MOqu7eWmtxhYHCVA==',key_name='tempest-TestMinimumBasicScenario-886197037',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-9slf0web',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4fadb98e-10b3-4546-840a-de38725bcc8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:18:39Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=0c2f1ca8-4e83-4738-8cf3-041685ef8c40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "address": "fa:16:3e:c3:64:32", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3632a0dc-89", "ovs_interfaceid": "3632a0dc-897c-4f27-b6f8-ac192c6fbcf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG os_vif [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3632a0dc-89, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:21:22 user nova-compute[72929]: INFO os_vif [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:64:32,bridge_name='br-int',has_traffic_filtering=True,id=3632a0dc-897c-4f27-b6f8-ac192c6fbcf1,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3632a0dc-89')
Aug 26 22:21:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Deleting instance files /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40_del
Aug 26 22:21:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Deletion of /opt/stack/data/nova/instances/0c2f1ca8-4e83-4738-8cf3-041685ef8c40_del complete
Aug 26 22:21:22 user nova-compute[72929]: INFO nova.compute.manager [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 26 22:21:22 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:21:22 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Took 0.59 seconds to deallocate network for instance.
Aug 26 22:21:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:23 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Deleted allocations for instance 0c2f1ca8-4e83-4738-8cf3-041685ef8c40
Aug 26 22:21:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f9d9aaea-1386-4752-a907-565c79b63153 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] Acquiring lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] Lock "0c2f1ca8-4e83-4738-8cf3-041685ef8c40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] No waiting events found dispatching network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:21:23 user nova-compute[72929]: WARNING nova.compute.manager [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received unexpected event network-vif-plugged-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 for instance with vm_state deleted and task_state None.
Aug 26 22:21:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-e88dfd1c-fad3-470f-9ba6-eb79b2413037 req-641d8c51-f5a6-453e-81d4-b3898f57065f service nova] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Received event network-vif-deleted-3632a0dc-897c-4f27-b6f8-ac192c6fbcf1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:21:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSjrfklX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:21:31 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:31 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:31 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b98517d-af95-44da-9c8b-5a6f27cd6b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:21:31 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1cfd5c-945f-416a-8c34-3f79de7dc2a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8] added
Aug 26 22:21:31 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1460447b-c90d-448b-bd56-5cd58f507112]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2ed83a-2851-4f43-bb03-19062e0c2555]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:31 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSjrfklX {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSjrfklX" returned: 0 in 0.040s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a7b479-7a91-4caa-9653-6cde49c39f89]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oSjrfklX'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b51c002-50d1-4de4-878e-ce07534376a3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa0371-6297-48ad-ae73-4b87d9801f64]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[346afb19-dc45-4c17-bc2e-f40fec359c9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260]
Aug 26 22:21:32 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260] successful.
Aug 26 22:21:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfa2ccb-5f88-43aa-a032-9eccb8d644d6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1573d71-3d36-4fea-ba54-a0220a51cab0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 (non-flash)
Aug 26 22:21:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:32 user nova-compute[72929]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 (non-flash)
Aug 26 22:21:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] HCTL ('37', '-', '-', 0) found on session 49 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[315345a8-3ce2-42a2-97ce-5f21fd83a84e]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Searching for a device in session 49 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSjrfklX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:21:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23064366262373032', 'path': '/dev/sdf'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064366262373032', 'path': '/dev/sdf'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG nova.objects.instance [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lazy-loading 'flavor' on Instance uuid b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:21:33 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:21:33 user nova-compute[72929]:   <source dev="/dev/sdf"/>
Aug 26 22:21:33 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:21:33 user nova-compute[72929]:   <serial>6e574a22-e7d2-47de-8ac0-cee8a2964aa8</serial>
Aug 26 22:21:33 user nova-compute[72929]: </disk>
Aug 26 22:21:33 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] No VIF found with MAC fa:16:3e:b7:8b:ce, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:21:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-8a237c91-df28-430e-875f-2c21920539f4 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.858s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:36 user nova-compute[72929]: INFO nova.compute.manager [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Detaching volume 6e574a22-e7d2-47de-8ac0-cee8a2964aa8
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:21:36 user nova-compute[72929]: INFO nova.virt.block_device [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Attempting to driver detach volume 6e574a22-e7d2-47de-8ac0-cee8a2964aa8 from mountpoint /dev/vdb
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Attempting to detach device vdb from instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:21:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:21:36 user nova-compute[72929]:   <source dev="/dev/sdf"/>
Aug 26 22:21:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:21:36 user nova-compute[72929]:   <serial>6e574a22-e7d2-47de-8ac0-cee8a2964aa8</serial>
Aug 26 22:21:36 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:21:36 user nova-compute[72929]: </disk>
Aug 26 22:21:36 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:21:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Successfully detached device vdb from instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 from the persistent domain config.
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:21:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:21:36 user nova-compute[72929]:   <source dev="/dev/sdf"/>
Aug 26 22:21:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:21:36 user nova-compute[72929]:   <serial>6e574a22-e7d2-47de-8ac0-cee8a2964aa8</serial>
Aug 26 22:21:36 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:21:36 user nova-compute[72929]: </disk>
Aug 26 22:21:36 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088496.9517095, b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:21:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Successfully detached device vdb from instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 from the live domain config.
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSjrfklX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:21:36 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:21:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf066417-09e9-426c-bbc9-87f2d9e5cc03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:36 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f1ec0f-0f11-45ce-ad57-9e6d089d59c4]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 (non-flash)
Aug 26 22:21:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:21:37 user nova-compute[72929]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 (non-flash)
Aug 26 22:21:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804d5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8'): ({'sdf'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Removing single pathed devices sdf {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a734d36d-b61f-4dec-bb65-75c563d46f3b]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b5e626-64b2-410a-860b-d7e31cce957e]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Flushing IO for device /dev/sdf {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5e47ea-9132-4745-870c-9e095baf5590]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e6d73f-4873-4c41-977b-c1c074aa6011]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[383847ef-2785-44f9-9b05-0088fa29ae4c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088482.1892953, 0c2f1ca8-4e83-4738-8cf3-041685ef8c40 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:21:37 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] VM Stopped (Lifecycle Event)
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef785c7c-993f-4f5c-8f00-940926e7cbd5 None None] [instance: 0c2f1ca8-4e83-4738-8cf3-041685ef8c40] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b60179-518e-4441-b676-5a14884d16c5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260]
Aug 26 22:21:37 user nova-compute[72929]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8, portal: 172.16.0.220,3260] successful.
Aug 26 22:21:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e574a22-e7d2-47de-8ac0-cee8a2964aa8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37546436-3161-42e1-9d91-9338797a573c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] <== disconnect_volume: return (320ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.objects.instance [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lazy-loading 'flavor' on Instance uuid b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-2b7745ae-8dbf-480d-87bd-4f423a459459 tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.765s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:38 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:21:38 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7974MB free_disk=24.01721954345703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5be90001-c03f-466e-a8d1-bc167da12cc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:21:38 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:21:39 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:21:39 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:21:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:21:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:21:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:21:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:21:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:21:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:00 user nova-compute[72929]: INFO nova.compute.manager [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Detaching volume ced33568-0e2f-4459-94a0-aa7ecba4ca75
Aug 26 22:22:00 user nova-compute[72929]: INFO nova.virt.block_device [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Attempting to driver detach volume ced33568-0e2f-4459-94a0-aa7ecba4ca75 from mountpoint /dev/vdb
Aug 26 22:22:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Attempting to detach device vdb from instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:22:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:22:00 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:22:00 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:22:00 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:22:00 user nova-compute[72929]:   <serial>ced33568-0e2f-4459-94a0-aa7ecba4ca75</serial>
Aug 26 22:22:00 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:22:00 user nova-compute[72929]: </disk>
Aug 26 22:22:00 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:22:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:00 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully detached device vdb from instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 from the persistent domain config.
Aug 26 22:22:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:22:00 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:22:00 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:22:00 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:22:00 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:22:00 user nova-compute[72929]:   <serial>ced33568-0e2f-4459-94a0-aa7ecba4ca75</serial>
Aug 26 22:22:00 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:22:00 user nova-compute[72929]: </disk>
Aug 26 22:22:00 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088521.1332493, cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:22:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully detached device vdb from instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 from the live domain config.
Aug 26 22:22:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTRPdNLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:22:01 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc17d1-8db3-4be3-98cf-79dc1db3aa4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a8ceac-3da6-47ef-b0ec-8b388efd599d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:22:01 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:22:01 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:22:01 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:22:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:22:01 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:22:01 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:22:01 user nova-compute[72929]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 (non-flash)
Aug 26 22:22:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804d25f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9c2c7-1706-473e-876a-b350ba7bdde0]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ffef26-abda-4f16-b38e-5b854ca8b4fc]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f4b90e-b8a9-49e0-a8c5-e384413e1c23]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[876dfdf4-b951-412c-89b2-7233f7c61fd0]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[14060d7f-02c6-4de9-9217-fda9ab606f3a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36b864-db45-425d-978c-e80f84e93ea3]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260]
Aug 26 22:22:01 user nova-compute[72929]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75, portal: 172.16.0.220,3260] successful.
Aug 26 22:22:01 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809406c-8de0-4bb9-b535-43532f7d1483]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== disconnect_volume: return (293ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:22:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'flavor' on Instance uuid cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0b9deac4-d748-492e-b0c4-397a8aba1819 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.535s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:02 user nova-compute[72929]: INFO nova.compute.manager [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Terminating instance
Aug 26 22:22:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-f146ce9a-9823-4e2f-bf5b-24da3d969c7a req-a359b116-4716-4a63-b92a-09c56180d759 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-vif-unplugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f146ce9a-9823-4e2f-bf5b-24da3d969c7a req-a359b116-4716-4a63-b92a-09c56180d759 service nova] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f146ce9a-9823-4e2f-bf5b-24da3d969c7a req-a359b116-4716-4a63-b92a-09c56180d759 service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f146ce9a-9823-4e2f-bf5b-24da3d969c7a req-a359b116-4716-4a63-b92a-09c56180d759 service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-f146ce9a-9823-4e2f-bf5b-24da3d969c7a req-a359b116-4716-4a63-b92a-09c56180d759 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] No waiting events found dispatching network-vif-unplugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-f146ce9a-9823-4e2f-bf5b-24da3d969c7a req-a359b116-4716-4a63-b92a-09c56180d759 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-vif-unplugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:22:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Instance destroyed successfully.
Aug 26 22:22:02 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'resources' on Instance uuid cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-243775865',display_name='tempest-VolumesSnapshotTestJSON-instance-243775865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-243775865',id=38,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMYIBVhDe/4WWB2oXrQNqsag5PW/UPBh2hjidErYLoMvlm8poxXy4jJcRKvw6X0sexww4E8FZbU0bR2xNPQcPnVTeeF8S+SmpJ+ATHCzRLiV2WascmQzq74mP9vO32mKQ==',key_name='tempest-keypair-278061947',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:19:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c59076b100394311b871aff3d8232639',ramdisk_id='',reservation_id='r-xkilem1a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1269723',owner_user_name='tempest-VolumesSnapshotTestJSON-1269723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:19:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270ea6e7f5ac4e64874f9d7aaf211b33',uuid=cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converting VIF {"id": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "address": "fa:16:3e:f1:6a:fe", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8e0004f-55", "ovs_interfaceid": "c8e0004f-55ae-4dd7-88ba-95ff1e23cace", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_vif [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8e0004f-55, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:03 user nova-compute[72929]: INFO os_vif [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:6a:fe,bridge_name='br-int',has_traffic_filtering=True,id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8e0004f-55')
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HTRPdNLa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:22:03 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ced33568-0e2f-4459-94a0-aa7ecba4ca75', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37811a49-068c-4292-8448-f5987fd5597a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[652738eb-61cd-42da-b039-550135c09003]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:22:03 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:22:03 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:22:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:22:03 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:22:03 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:22:03 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8017caf0>, {}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Disconnecting from: [] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== disconnect_volume: return (50ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:22:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Deleting instance files /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9_del
Aug 26 22:22:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Deletion of /opt/stack/data/nova/instances/cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9_del complete
Aug 26 22:22:03 user nova-compute[72929]: INFO nova.compute.manager [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 26 22:22:03 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:22:03 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:04 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Took 1.05 seconds to deallocate network for instance.
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-1001c142-1795-4a6d-babd-a1de2bd0ba17 req-fd9e7782-4909-493c-b69b-11287ab53b40 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-vif-deleted-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:04 user nova-compute[72929]: INFO nova.compute.manager [req-1001c142-1795-4a6d-babd-a1de2bd0ba17 req-fd9e7782-4909-493c-b69b-11287ab53b40 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Neutron deleted interface c8e0004f-55ae-4dd7-88ba-95ff1e23cace; detaching it from the instance and deleting it from the info cache
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.network.neutron [req-1001c142-1795-4a6d-babd-a1de2bd0ba17 req-fd9e7782-4909-493c-b69b-11287ab53b40 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:04 user nova-compute[72929]: WARNING nova.volume.cinder [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Attachment d1fa8546-bcd7-4604-b00d-795eecd12d21 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d1fa8546-bcd7-4604-b00d-795eecd12d21. (HTTP 404) (Request-ID: req-0b478c1d-34c9-46bf-abd9-bfd8beba7a6a)
Aug 26 22:22:04 user nova-compute[72929]: INFO nova.compute.manager [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Took 0.04 seconds to detach 1 volumes for instance.
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-1001c142-1795-4a6d-babd-a1de2bd0ba17 req-fd9e7782-4909-493c-b69b-11287ab53b40 service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Detach interface failed, port_id=c8e0004f-55ae-4dd7-88ba-95ff1e23cace, reason: Instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-2876e4a3-e20a-476e-8885-1228a2d770e4 req-f4d67a4d-75ae-485b-ba45-bb2d45d455fb service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received event network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2876e4a3-e20a-476e-8885-1228a2d770e4 req-f4d67a4d-75ae-485b-ba45-bb2d45d455fb service nova] Acquiring lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2876e4a3-e20a-476e-8885-1228a2d770e4 req-f4d67a4d-75ae-485b-ba45-bb2d45d455fb service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-2876e4a3-e20a-476e-8885-1228a2d770e4 req-f4d67a4d-75ae-485b-ba45-bb2d45d455fb service nova] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-2876e4a3-e20a-476e-8885-1228a2d770e4 req-f4d67a4d-75ae-485b-ba45-bb2d45d455fb service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] No waiting events found dispatching network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:04 user nova-compute[72929]: WARNING nova.compute.manager [req-2876e4a3-e20a-476e-8885-1228a2d770e4 req-f4d67a4d-75ae-485b-ba45-bb2d45d455fb service nova] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Received unexpected event network-vif-plugged-c8e0004f-55ae-4dd7-88ba-95ff1e23cace for instance with vm_state deleted and task_state None.
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:04 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Deleted allocations for instance cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9
Aug 26 22:22:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3865eee8-2222-48a3-9916-ab09d0c5a36c tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.631s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:06 user nova-compute[72929]: DEBUG nova.compute.manager [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing instance network info cache due to event network-changed-fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:22:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] Acquiring lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] Acquired lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:06 user nova-compute[72929]: DEBUG nova.network.neutron [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Refreshing network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:07 user nova-compute[72929]: INFO nova.compute.manager [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Terminating instance
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-bbe075fe-9eb7-40b0-a8f7-28735596390d req-e98af5de-c252-40db-8b66-4907fd83dfbe service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-unplugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bbe075fe-9eb7-40b0-a8f7-28735596390d req-e98af5de-c252-40db-8b66-4907fd83dfbe service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bbe075fe-9eb7-40b0-a8f7-28735596390d req-e98af5de-c252-40db-8b66-4907fd83dfbe service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bbe075fe-9eb7-40b0-a8f7-28735596390d req-e98af5de-c252-40db-8b66-4907fd83dfbe service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-bbe075fe-9eb7-40b0-a8f7-28735596390d req-e98af5de-c252-40db-8b66-4907fd83dfbe service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-unplugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-bbe075fe-9eb7-40b0-a8f7-28735596390d req-e98af5de-c252-40db-8b66-4907fd83dfbe service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-unplugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updated VIF entry in instance network info cache for port fcda8100-bab8-4241-b6d2-b0be62aec358. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.network.neutron [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [{"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e93e7764-f5bc-4f8c-98da-d2045c74241c req-baebf57e-06eb-4d12-8be0-551306da43d0 service nova] Releasing lock "refresh_cache-1b278bf0-b061-48a8-86e2-c1f7680bd6e4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Instance destroyed successfully.
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.objects.instance [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lazy-loading 'resources' on Instance uuid 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-26T22:16:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-921211666',display_name='tempest-TestShelveInstance-server-921211666',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-921211666',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHemdFX1cO+B8kuenIxngh+ThWWNvP/EU6LN1bX44C97F6N1TQvhO2AvND4k6LCdffbdaS7EHlRHd8ulCpjGZPdYbaJSb2sBemNpFh0o5X1cDHQBw2QemZcRrFGnc/reqw==',key_name='tempest-TestShelveInstance-1482362583',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48d5337fa05b4872a0589f369a799195',ramdisk_id='',reservation_id='r-oj2wastp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1331467690',owner_user_name='tempest-TestShelveInstance-1331467690-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:20:34Z,user_data=None,user_id='814a67adaa1c4fdea167130c337403ef',uuid=1b278bf0-b061-48a8-86e2-c1f7680bd6e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converting VIF {"id": "fcda8100-bab8-4241-b6d2-b0be62aec358", "address": "fa:16:3e:e8:9f:ea", "network": {"id": "2e210bfe-758f-40ed-9190-7900b07f08ba", "bridge": "br-int", "label": "tempest-TestShelveInstance-1063816925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48d5337fa05b4872a0589f369a799195", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcda8100-ba", "ovs_interfaceid": "fcda8100-bab8-4241-b6d2-b0be62aec358", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_vif [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcda8100-ba, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:07 user nova-compute[72929]: INFO os_vif [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:9f:ea,bridge_name='br-int',has_traffic_filtering=True,id=fcda8100-bab8-4241-b6d2-b0be62aec358,network=Network(2e210bfe-758f-40ed-9190-7900b07f08ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcda8100-ba')
Aug 26 22:22:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YTEGpafH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:22:07 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d332f66-e5e4-4334-889a-c3afce979400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb14631a-80b9-4904-8940-2c3f5661d32d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:22:07 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:22:07 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:22:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:22:07 user nova-compute[72929]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a (non-flash)
Aug 26 22:22:07 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:22:07 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e4fd5-607c-4b02-b2a5-13491f732233]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[de21838a-908a-4c79-be03-cbb60895e1bc]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b021acfc-6ffd-489d-b815-ced1978a9309]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:22:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bc4d9d-4128-40ae-b5ef-b76bf32df3ca]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3221fcad-a0f7-4ecf-a8c0-0f2371630dc4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2455c6b3-9654-421e-8e9c-7382a253d9ec]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260]
Aug 26 22:22:08 user nova-compute[72929]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a, portal: 172.16.0.220,3260] successful.
Aug 26 22:22:08 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008a85d8-b5e2-40f3-9fad-916b78c4044a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a972a-51f5-4ec6-b20d-4de3b9cdeda8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] <== disconnect_volume: return (293ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:22:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Deleting instance files /opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4_del
Aug 26 22:22:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Deletion of /opt/stack/data/nova/instances/1b278bf0-b061-48a8-86e2-c1f7680bd6e4_del complete
Aug 26 22:22:08 user nova-compute[72929]: INFO nova.compute.manager [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 26 22:22:08 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:22:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:09 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Took 0.86 seconds to deallocate network for instance.
Aug 26 22:22:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f1319898-89a8-45df-b157-141969184983 req-8326487b-2cfd-4717-b1c5-de684d1dba2b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-deleted-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:09 user nova-compute[72929]: INFO nova.compute.manager [req-f1319898-89a8-45df-b157-141969184983 req-8326487b-2cfd-4717-b1c5-de684d1dba2b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Neutron deleted interface fcda8100-bab8-4241-b6d2-b0be62aec358; detaching it from the instance and deleting it from the info cache
Aug 26 22:22:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-f1319898-89a8-45df-b157-141969184983 req-8326487b-2cfd-4717-b1c5-de684d1dba2b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-f1319898-89a8-45df-b157-141969184983 req-8326487b-2cfd-4717-b1c5-de684d1dba2b service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Detach interface failed, port_id=fcda8100-bab8-4241-b6d2-b0be62aec358, reason: Instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-d0dd4741-6f1b-4662-a11d-17ce7ad7b3d6 req-01e8e170-de66-4e40-999f-5b17b849fcfd service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d0dd4741-6f1b-4662-a11d-17ce7ad7b3d6 req-01e8e170-de66-4e40-999f-5b17b849fcfd service nova] Acquiring lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d0dd4741-6f1b-4662-a11d-17ce7ad7b3d6 req-01e8e170-de66-4e40-999f-5b17b849fcfd service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d0dd4741-6f1b-4662-a11d-17ce7ad7b3d6 req-01e8e170-de66-4e40-999f-5b17b849fcfd service nova] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-d0dd4741-6f1b-4662-a11d-17ce7ad7b3d6 req-01e8e170-de66-4e40-999f-5b17b849fcfd service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] No waiting events found dispatching network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:09 user nova-compute[72929]: WARNING nova.compute.manager [req-d0dd4741-6f1b-4662-a11d-17ce7ad7b3d6 req-01e8e170-de66-4e40-999f-5b17b849fcfd service nova] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Received unexpected event network-vif-plugged-fcda8100-bab8-4241-b6d2-b0be62aec358 for instance with vm_state active and task_state deleting.
Aug 26 22:22:10 user nova-compute[72929]: INFO nova.compute.manager [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Took 0.97 seconds to detach 1 volumes for instance.
Aug 26 22:22:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Deleting volume: 008a85d8-b5e2-40f3-9fad-916b78c4044a {{(pid=72929) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 22:22:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:10 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:10 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:10 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Deleted allocations for instance 1b278bf0-b061-48a8-86e2-c1f7680bd6e4
Aug 26 22:22:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-0744860f-31d1-4e7f-acc7-45c723b57549 tempest-TestShelveInstance-1331467690 tempest-TestShelveInstance-1331467690-project-member] Lock "1b278bf0-b061-48a8-86e2-c1f7680bd6e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.461s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:22:11 user nova-compute[72929]: INFO nova.compute.claims [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Claim successful on node user
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:22:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:22:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Creating image(s)
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "/opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG nova.policy [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc2833663e85431fa3433a128520c8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc89a603c20492d9a2f41085f0e10f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk 1073741824" returned: 0 in 0.057s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Successfully created port: 3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Cannot resize image /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Ensure instance console log exists: /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Successfully updated port: 3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-changed-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Refreshing instance network info cache due to event network-changed-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] Acquiring lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updating instance_info_cache with network_info: [{"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Instance network_info: |[{"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] Acquired lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Refreshing network info cache for port 3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Start _get_guest_xml network_info=[{"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:22:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:22:13 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1683106429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1683106429',id=41,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-n1sn4zsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:22:12Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=83ba3bb1-8898-4e12-ac70-84c2c028dbcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.objects.instance [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ba3bb1-8898-4e12-ac70-84c2c028dbcc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:22:13 user nova-compute[72929]:   <uuid>83ba3bb1-8898-4e12-ac70-84c2c028dbcc</uuid>
Aug 26 22:22:13 user nova-compute[72929]:   <name>instance-00000029</name>
Aug 26 22:22:13 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:22:13 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:22:13 user nova-compute[72929]:   <metadata>
Aug 26 22:22:13 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:22:13 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:22:13 user nova-compute[72929]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1683106429</nova:name>
Aug 26 22:22:13 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:22:13</nova:creationTime>
Aug 26 22:22:13 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:22:13 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:22:13 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:22:13 user nova-compute[72929]:       <nova:owner>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:user uuid="cc2833663e85431fa3433a128520c8a8">tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member</nova:user>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:project uuid="dcc89a603c20492d9a2f41085f0e10f5">tempest-ServerBootFromVolumeStableRescueTest-650830425</nova:project>
Aug 26 22:22:13 user nova-compute[72929]:       </nova:owner>
Aug 26 22:22:13 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:22:13 user nova-compute[72929]:       <nova:ports>
Aug 26 22:22:13 user nova-compute[72929]:         <nova:port uuid="3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2">
Aug 26 22:22:13 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 26 22:22:13 user nova-compute[72929]:         </nova:port>
Aug 26 22:22:13 user nova-compute[72929]:       </nova:ports>
Aug 26 22:22:13 user nova-compute[72929]:     </nova:instance>
Aug 26 22:22:13 user nova-compute[72929]:   </metadata>
Aug 26 22:22:13 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:22:13 user nova-compute[72929]:     <system>
Aug 26 22:22:13 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:22:13 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:22:13 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:22:13 user nova-compute[72929]:       <entry name="serial">83ba3bb1-8898-4e12-ac70-84c2c028dbcc</entry>
Aug 26 22:22:13 user nova-compute[72929]:       <entry name="uuid">83ba3bb1-8898-4e12-ac70-84c2c028dbcc</entry>
Aug 26 22:22:13 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:22:13 user nova-compute[72929]:     </system>
Aug 26 22:22:13 user nova-compute[72929]:   </sysinfo>
Aug 26 22:22:13 user nova-compute[72929]:   <os>
Aug 26 22:22:13 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:22:13 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:22:13 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:22:13 user nova-compute[72929]:   </os>
Aug 26 22:22:13 user nova-compute[72929]:   <features>
Aug 26 22:22:13 user nova-compute[72929]:     <acpi/>
Aug 26 22:22:13 user nova-compute[72929]:     <apic/>
Aug 26 22:22:13 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:22:13 user nova-compute[72929]:   </features>
Aug 26 22:22:13 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:22:13 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:22:13 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:22:13 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:22:13 user nova-compute[72929]:   </clock>
Aug 26 22:22:13 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:22:13 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:22:13 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:22:13 user nova-compute[72929]:   </cpu>
Aug 26 22:22:13 user nova-compute[72929]:   <devices>
Aug 26 22:22:13 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:22:13 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:22:13 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk"/>
Aug 26 22:22:13 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:22:13 user nova-compute[72929]:     </disk>
Aug 26 22:22:13 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:22:13 user nova-compute[72929]:       <mac address="fa:16:3e:f2:5d:0e"/>
Aug 26 22:22:13 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:22:13 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:22:13 user nova-compute[72929]:       <target dev="tap3f7fc57e-2e"/>
Aug 26 22:22:13 user nova-compute[72929]:     </interface>
Aug 26 22:22:13 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:22:13 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/console.log" append="off"/>
Aug 26 22:22:13 user nova-compute[72929]:     </serial>
Aug 26 22:22:13 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:22:13 user nova-compute[72929]:     <video>
Aug 26 22:22:13 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:22:13 user nova-compute[72929]:     </video>
Aug 26 22:22:13 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:22:13 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:22:13 user nova-compute[72929]:     </rng>
Aug 26 22:22:13 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:22:13 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:22:13 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:22:13 user nova-compute[72929]:     </memballoon>
Aug 26 22:22:13 user nova-compute[72929]:   </devices>
Aug 26 22:22:13 user nova-compute[72929]: </domain>
Aug 26 22:22:13 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1683106429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1683106429',id=41,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-n1sn4zsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:22:12Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=83ba3bb1-8898-4e12-ac70-84c2c028dbcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG os_vif [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f7fc57e-2e, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f7fc57e-2e, col_values=(('external_ids', {'iface-id': '3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:5d:0e', 'vm-uuid': '83ba3bb1-8898-4e12-ac70-84c2c028dbcc'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:13 user nova-compute[72929]: INFO os_vif [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e')
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No VIF found with MAC fa:16:3e:f2:5d:0e, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updated VIF entry in instance network info cache for port 3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:22:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updating instance_info_cache with network_info: [{"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0409d2ee-ea63-4d77-bb34-6ed432129c7a req-f18f0db6-e8ac-455c-9273-6c8270e9dac8 service nova] Releasing lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-09bd8110-23a2-4b5b-b1ff-d74fdfe50474 req-b2f8f46c-989e-4a41-a116-231faf8778d2 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-09bd8110-23a2-4b5b-b1ff-d74fdfe50474 req-b2f8f46c-989e-4a41-a116-231faf8778d2 service nova] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-09bd8110-23a2-4b5b-b1ff-d74fdfe50474 req-b2f8f46c-989e-4a41-a116-231faf8778d2 service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-09bd8110-23a2-4b5b-b1ff-d74fdfe50474 req-b2f8f46c-989e-4a41-a116-231faf8778d2 service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG nova.compute.manager [req-09bd8110-23a2-4b5b-b1ff-d74fdfe50474 req-b2f8f46c-989e-4a41-a116-231faf8778d2 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] No waiting events found dispatching network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:15 user nova-compute[72929]: WARNING nova.compute.manager [req-09bd8110-23a2-4b5b-b1ff-d74fdfe50474 req-b2f8f46c-989e-4a41-a116-231faf8778d2 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received unexpected event network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 for instance with vm_state building and task_state spawning.
Aug 26 22:22:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:15 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:22:15 user nova-compute[72929]: INFO nova.compute.claims [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Claim successful on node user
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.network.neutron [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:22:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.policy [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '288d81e675df48b399f1635e05700193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b4cbef9286450aba00ce7ebd1cd360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:22:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Creating image(s)
Aug 26 22:22:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "/opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "/opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "/opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.part --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.images [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] f0384cef-6413-49d1-a0ab-3bebdd3d01f6 was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.part /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.network.neutron [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Successfully created port: fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-425b57fc-09a6-45b2-9c37-fa87c370da92 req-fdbe5c9d-6d3c-4031-add9-cce863bf60c5 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-425b57fc-09a6-45b2-9c37-fa87c370da92 req-fdbe5c9d-6d3c-4031-add9-cce863bf60c5 service nova] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-425b57fc-09a6-45b2-9c37-fa87c370da92 req-fdbe5c9d-6d3c-4031-add9-cce863bf60c5 service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-425b57fc-09a6-45b2-9c37-fa87c370da92 req-fdbe5c9d-6d3c-4031-add9-cce863bf60c5 service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [req-425b57fc-09a6-45b2-9c37-fa87c370da92 req-fdbe5c9d-6d3c-4031-add9-cce863bf60c5 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] No waiting events found dispatching network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:17 user nova-compute[72929]: WARNING nova.compute.manager [req-425b57fc-09a6-45b2-9c37-fa87c370da92 req-fdbe5c9d-6d3c-4031-add9-cce863bf60c5 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received unexpected event network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 for instance with vm_state building and task_state spawning.
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088537.5573387, 83ba3bb1-8898-4e12-ac70-84c2c028dbcc => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] VM Resumed (Lifecycle Event)
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Instance spawned successfully.
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088537.5628648, 83ba3bb1-8898-4e12-ac70-84c2c028dbcc => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] VM Started (Lifecycle Event)
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.part /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.converted" returned: 0 in 0.533s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Took 6.83 seconds to build instance.
Aug 26 22:22:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bd4d0384-cfa9-476c-936d-1a48faa3aca3 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.936s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:17 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088522.9870992, cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:17 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] VM Stopped (Lifecycle Event)
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b5d24634-e7a0-4577-9d61-870d34ad6ecf None None] [instance: cb95fe1b-978f-46ed-8fd7-9dfdcfdb1dd9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.582s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Successfully updated port: fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 --force-share --output=json" returned: 0 in 0.199s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9,backing_fmt=raw /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9,backing_fmt=raw /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk 1073741824" returned: 0 in 0.060s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.network.neutron [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance network_info: |[{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Cannot resize image /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Ensure instance console log exists: /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Start _get_guest_xml network_info=[{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T22:22:13Z,direct_url=<?>,disk_format='qcow2',id=f0384cef-6413-49d1-a0ab-3bebdd3d01f6,min_disk=0,min_ram=0,name='tempest-scenario-img--260910621',owner='01b4cbef9286450aba00ce7ebd1cd360',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T22:22:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': 'f0384cef-6413-49d1-a0ab-3bebdd3d01f6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:22:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:22:18 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T22:22:13Z,direct_url=<?>,disk_format='qcow2',id=f0384cef-6413-49d1-a0ab-3bebdd3d01f6,min_disk=0,min_ram=0,name='tempest-scenario-img--260910621',owner='01b4cbef9286450aba00ce7ebd1cd360',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T22:22:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:22:18 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1677838787',display_name='tempest-TestMinimumBasicScenario-server-1677838787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1677838787',id=42,image_ref='f0384cef-6413-49d1-a0ab-3bebdd3d01f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6fIxIdG01+r8cfZ2zGASTyVoZ1Vs+p+S9HEIuXWWNT1fqYEFvFdb++a37XNWH9kLn+colDRYhrOdacw40ykKhb8myBFn5rgK+rNjMmkynOw3p77c/sdeFMxwwttZZEwQ==',key_name='tempest-TestMinimumBasicScenario-1934305128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-pnhmx0ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f0384cef-6413-49d1-a0ab-3bebdd3d01f6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:22:16Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=6426d900-d9c6-464e-aac3-a22392b39f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'pci_devices' on Instance uuid 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:22:19 user nova-compute[72929]:   <uuid>6426d900-d9c6-464e-aac3-a22392b39f9c</uuid>
Aug 26 22:22:19 user nova-compute[72929]:   <name>instance-0000002a</name>
Aug 26 22:22:19 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:22:19 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:22:19 user nova-compute[72929]:   <metadata>
Aug 26 22:22:19 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:22:19 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:22:19 user nova-compute[72929]:       <nova:name>tempest-TestMinimumBasicScenario-server-1677838787</nova:name>
Aug 26 22:22:19 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:22:18</nova:creationTime>
Aug 26 22:22:19 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:22:19 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:22:19 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:22:19 user nova-compute[72929]:       <nova:owner>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:user uuid="288d81e675df48b399f1635e05700193">tempest-TestMinimumBasicScenario-1162639748-project-member</nova:user>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:project uuid="01b4cbef9286450aba00ce7ebd1cd360">tempest-TestMinimumBasicScenario-1162639748</nova:project>
Aug 26 22:22:19 user nova-compute[72929]:       </nova:owner>
Aug 26 22:22:19 user nova-compute[72929]:       <nova:root type="image" uuid="f0384cef-6413-49d1-a0ab-3bebdd3d01f6"/>
Aug 26 22:22:19 user nova-compute[72929]:       <nova:ports>
Aug 26 22:22:19 user nova-compute[72929]:         <nova:port uuid="fb64b410-f883-4c5b-ba7d-b8374d1ff579">
Aug 26 22:22:19 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 22:22:19 user nova-compute[72929]:         </nova:port>
Aug 26 22:22:19 user nova-compute[72929]:       </nova:ports>
Aug 26 22:22:19 user nova-compute[72929]:     </nova:instance>
Aug 26 22:22:19 user nova-compute[72929]:   </metadata>
Aug 26 22:22:19 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:22:19 user nova-compute[72929]:     <system>
Aug 26 22:22:19 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:22:19 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:22:19 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:22:19 user nova-compute[72929]:       <entry name="serial">6426d900-d9c6-464e-aac3-a22392b39f9c</entry>
Aug 26 22:22:19 user nova-compute[72929]:       <entry name="uuid">6426d900-d9c6-464e-aac3-a22392b39f9c</entry>
Aug 26 22:22:19 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:22:19 user nova-compute[72929]:     </system>
Aug 26 22:22:19 user nova-compute[72929]:   </sysinfo>
Aug 26 22:22:19 user nova-compute[72929]:   <os>
Aug 26 22:22:19 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:22:19 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:22:19 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:22:19 user nova-compute[72929]:   </os>
Aug 26 22:22:19 user nova-compute[72929]:   <features>
Aug 26 22:22:19 user nova-compute[72929]:     <acpi/>
Aug 26 22:22:19 user nova-compute[72929]:     <apic/>
Aug 26 22:22:19 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:22:19 user nova-compute[72929]:   </features>
Aug 26 22:22:19 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:22:19 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:22:19 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:22:19 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:22:19 user nova-compute[72929]:   </clock>
Aug 26 22:22:19 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:22:19 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:22:19 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:22:19 user nova-compute[72929]:   </cpu>
Aug 26 22:22:19 user nova-compute[72929]:   <devices>
Aug 26 22:22:19 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:22:19 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:22:19 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk"/>
Aug 26 22:22:19 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:22:19 user nova-compute[72929]:     </disk>
Aug 26 22:22:19 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:22:19 user nova-compute[72929]:       <mac address="fa:16:3e:79:55:7f"/>
Aug 26 22:22:19 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:22:19 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:22:19 user nova-compute[72929]:       <target dev="tapfb64b410-f8"/>
Aug 26 22:22:19 user nova-compute[72929]:     </interface>
Aug 26 22:22:19 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:22:19 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/console.log" append="off"/>
Aug 26 22:22:19 user nova-compute[72929]:     </serial>
Aug 26 22:22:19 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:22:19 user nova-compute[72929]:     <video>
Aug 26 22:22:19 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:22:19 user nova-compute[72929]:     </video>
Aug 26 22:22:19 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:22:19 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:22:19 user nova-compute[72929]:     </rng>
Aug 26 22:22:19 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:22:19 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:22:19 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:22:19 user nova-compute[72929]:     </memballoon>
Aug 26 22:22:19 user nova-compute[72929]:   </devices>
Aug 26 22:22:19 user nova-compute[72929]: </domain>
Aug 26 22:22:19 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1677838787',display_name='tempest-TestMinimumBasicScenario-server-1677838787',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1677838787',id=42,image_ref='f0384cef-6413-49d1-a0ab-3bebdd3d01f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6fIxIdG01+r8cfZ2zGASTyVoZ1Vs+p+S9HEIuXWWNT1fqYEFvFdb++a37XNWH9kLn+colDRYhrOdacw40ykKhb8myBFn5rgK+rNjMmkynOw3p77c/sdeFMxwwttZZEwQ==',key_name='tempest-TestMinimumBasicScenario-1934305128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-pnhmx0ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f0384cef-6413-49d1-a0ab-3bebdd3d01f6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:22:16Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=6426d900-d9c6-464e-aac3-a22392b39f9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG os_vif [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb64b410-f8, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb64b410-f8, col_values=(('external_ids', {'iface-id': 'fb64b410-f883-4c5b-ba7d-b8374d1ff579', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:55:7f', 'vm-uuid': '6426d900-d9c6-464e-aac3-a22392b39f9c'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:19 user nova-compute[72929]: INFO os_vif [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8')
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No VIF found with MAC fa:16:3e:79:55:7f, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.compute.manager [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing instance network info cache due to event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updated VIF entry in instance network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG nova.network.neutron [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1447964b-8fcc-4043-b8c5-2e8b446620ce req-72833285-7a28-4909-800c-f8d4eb5e85c7 service nova] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-1b96cfd5-ca34-49ed-bb71-22c46bd4f1a4 req-654efe62-b90a-45ff-b367-0a94b7ff404f service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1b96cfd5-ca34-49ed-bb71-22c46bd4f1a4 req-654efe62-b90a-45ff-b367-0a94b7ff404f service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1b96cfd5-ca34-49ed-bb71-22c46bd4f1a4 req-654efe62-b90a-45ff-b367-0a94b7ff404f service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1b96cfd5-ca34-49ed-bb71-22c46bd4f1a4 req-654efe62-b90a-45ff-b367-0a94b7ff404f service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-1b96cfd5-ca34-49ed-bb71-22c46bd4f1a4 req-654efe62-b90a-45ff-b367-0a94b7ff404f service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:20 user nova-compute[72929]: WARNING nova.compute.manager [req-1b96cfd5-ca34-49ed-bb71-22c46bd4f1a4 req-654efe62-b90a-45ff-b367-0a94b7ff404f service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state building and task_state spawning.
Aug 26 22:22:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088527.8175747, 1b278bf0-b061-48a8-86e2-c1f7680bd6e4 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:22 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] VM Stopped (Lifecycle Event)
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bb2b8b71-442c-4eca-921c-98068866ab53 None None] [instance: 1b278bf0-b061-48a8-86e2-c1f7680bd6e4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-bdf54d30-7db8-466c-8d4d-ea219db5cf0f req-d2bfabec-3c9b-4fc3-ae97-f2e1e6844321 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdf54d30-7db8-466c-8d4d-ea219db5cf0f req-d2bfabec-3c9b-4fc3-ae97-f2e1e6844321 service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdf54d30-7db8-466c-8d4d-ea219db5cf0f req-d2bfabec-3c9b-4fc3-ae97-f2e1e6844321 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdf54d30-7db8-466c-8d4d-ea219db5cf0f req-d2bfabec-3c9b-4fc3-ae97-f2e1e6844321 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-bdf54d30-7db8-466c-8d4d-ea219db5cf0f req-d2bfabec-3c9b-4fc3-ae97-f2e1e6844321 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:22 user nova-compute[72929]: WARNING nova.compute.manager [req-bdf54d30-7db8-466c-8d4d-ea219db5cf0f req-d2bfabec-3c9b-4fc3-ae97-f2e1e6844321 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state building and task_state spawning.
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088542.8977997, 6426d900-d9c6-464e-aac3-a22392b39f9c => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] VM Resumed (Lifecycle Event)
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:22:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance spawned successfully.
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:22:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088542.8987339, 6426d900-d9c6-464e-aac3-a22392b39f9c => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] VM Started (Lifecycle Event)
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:22:23 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:22:23 user nova-compute[72929]: INFO nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Took 6.54 seconds to spawn the instance on the hypervisor.
Aug 26 22:22:23 user nova-compute[72929]: DEBUG nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:23 user nova-compute[72929]: INFO nova.compute.manager [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Took 7.22 seconds to build instance.
Aug 26 22:22:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-92cd6063-23ae-447e-9365-f18fe60917cf tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.369s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:22:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:22:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:22:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:34 user nova-compute[72929]: INFO nova.compute.manager [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Terminating instance
Aug 26 22:22:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-1740597b-9a1d-4306-b492-74401a3e5518 req-3d542545-8ca8-4983-bca2-4efefe5fe5dc service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-vif-unplugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1740597b-9a1d-4306-b492-74401a3e5518 req-3d542545-8ca8-4983-bca2-4efefe5fe5dc service nova] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1740597b-9a1d-4306-b492-74401a3e5518 req-3d542545-8ca8-4983-bca2-4efefe5fe5dc service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1740597b-9a1d-4306-b492-74401a3e5518 req-3d542545-8ca8-4983-bca2-4efefe5fe5dc service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-1740597b-9a1d-4306-b492-74401a3e5518 req-3d542545-8ca8-4983-bca2-4efefe5fe5dc service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] No waiting events found dispatching network-vif-unplugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-1740597b-9a1d-4306-b492-74401a3e5518 req-3d542545-8ca8-4983-bca2-4efefe5fe5dc service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-vif-unplugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:22:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Instance destroyed successfully.
Aug 26 22:22:35 user nova-compute[72929]: DEBUG nova.objects.instance [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lazy-loading 'resources' on Instance uuid b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:19:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-605893770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6058937',id=39,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1RQ7vanAxKMB2nUQLwvdLNJhPKUi2pdH2ghmI1RvzRbqr5BEuWVa0mZVyIDjOTr4bTfVcWut8+3DY8FEeInBjWRTkE44Kfk0YiuHaoSRi2IjylRelg9YH82/jadtNktg==',key_name='tempest-keypair-918265696',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:19:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43f10fe5a3eb4427936a0e95ffd1f363',ramdisk_id='',reservation_id='r-g8tzznqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-89857454',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:19:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d285158de464f8ebb394a0cfefa2127',uuid=b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Converting VIF {"id": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "address": "fa:16:3e:b7:8b:ce", "network": {"id": "a244bfc3-4fa5-48c0-a013-fad397e2fa4b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1359814319-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43f10fe5a3eb4427936a0e95ffd1f363", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4972ab13-0b", "ovs_interfaceid": "4972ab13-0b4f-4a7a-a31b-b6784886f462", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG os_vif [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4972ab13-0b, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:22:35 user nova-compute[72929]: INFO os_vif [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:8b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4972ab13-0b4f-4a7a-a31b-b6784886f462,network=Network(a244bfc3-4fa5-48c0-a013-fad397e2fa4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4972ab13-0b')
Aug 26 22:22:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Deleting instance files /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9_del
Aug 26 22:22:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Deletion of /opt/stack/data/nova/instances/b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9_del complete
Aug 26 22:22:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 26 22:22:35 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:22:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:36 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Took 1.24 seconds to deallocate network for instance.
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdcfa84e-922f-4594-80b3-7ab5a46c2532 req-9cd9a6c5-ad7b-4ba2-87ff-e8496e9e723e service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-vif-deleted-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:36 user nova-compute[72929]: INFO nova.compute.manager [req-cdcfa84e-922f-4594-80b3-7ab5a46c2532 req-9cd9a6c5-ad7b-4ba2-87ff-e8496e9e723e service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Neutron deleted interface 4972ab13-0b4f-4a7a-a31b-b6784886f462; detaching it from the instance and deleting it from the info cache
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-cdcfa84e-922f-4594-80b3-7ab5a46c2532 req-9cd9a6c5-ad7b-4ba2-87ff-e8496e9e723e service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-cdcfa84e-922f-4594-80b3-7ab5a46c2532 req-9cd9a6c5-ad7b-4ba2-87ff-e8496e9e723e service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Detach interface failed, port_id=4972ab13-0b4f-4a7a-a31b-b6784886f462, reason: Instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-f0e4a256-ef17-440a-833e-167ebed7add0 req-3d3a8b7a-8686-4eb1-ba6f-4f0f79447b38 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received event network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f0e4a256-ef17-440a-833e-167ebed7add0 req-3d3a8b7a-8686-4eb1-ba6f-4f0f79447b38 service nova] Acquiring lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f0e4a256-ef17-440a-833e-167ebed7add0 req-3d3a8b7a-8686-4eb1-ba6f-4f0f79447b38 service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f0e4a256-ef17-440a-833e-167ebed7add0 req-3d3a8b7a-8686-4eb1-ba6f-4f0f79447b38 service nova] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-f0e4a256-ef17-440a-833e-167ebed7add0 req-3d3a8b7a-8686-4eb1-ba6f-4f0f79447b38 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] No waiting events found dispatching network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:22:36 user nova-compute[72929]: WARNING nova.compute.manager [req-f0e4a256-ef17-440a-833e-167ebed7add0 req-3d3a8b7a-8686-4eb1-ba6f-4f0f79447b38 service nova] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Received unexpected event network-vif-plugged-4972ab13-0b4f-4a7a-a31b-b6784886f462 for instance with vm_state deleted and task_state None.
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:36 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Deleted allocations for instance b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-5d145a88-27a2-4317-ab0f-8608cb2d150c tempest-TestServerVolumeAttachScenarioOldVersion-89857454 tempest-TestServerVolumeAttachScenarioOldVersion-89857454-project-member] Lock "b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.604s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:22:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:39 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:22:39 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8015MB free_disk=23.995052337646484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5be90001-c03f-466e-a8d1-bc167da12cc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 6426d900-d9c6-464e-aac3-a22392b39f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:22:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-changed-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Refreshing instance network info cache due to event network-changed-b8db3359-f80b-4d0e-9ac2-78a9cde67727. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] Acquiring lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] Acquired lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Refreshing network info cache for port b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updated VIF entry in instance network info cache for port b8db3359-f80b-4d0e-9ac2-78a9cde67727. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updating instance_info_cache with network_info: [{"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:22:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8c1a68d5-c42d-417f-9067-ecd50ffc6eee req-057efe50-f3db-4394-998c-1443e948038c service nova] Releasing lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:22:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:22:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:50 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088555.2136712, b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:22:50 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] VM Stopped (Lifecycle Event)
Aug 26 22:22:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-fbd70252-14c8-44d0-ba01-d5f9b89b5157 None None] [instance: b8e14dd6-163f-4fc2-a2c3-4dac5a55a3f9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:22:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:22:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:22:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:22:57 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:22:57 user nova-compute[72929]: INFO nova.compute.claims [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Claim successful on node user
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:22:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:22:58 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:22:58 user nova-compute[72929]: INFO nova.virt.block_device [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Booting with volume snapshot 59925778-c702-4bdd-a221-0a7b1c6ae418 at /dev/vda
Aug 26 22:22:58 user nova-compute[72929]: DEBUG nova.policy [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf31c30629f7485a9b160f8d853096dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6b106b16484bfa8fd629b57527130f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:22:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:22:59 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Successfully created port: 9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Successfully updated port: 9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquired lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-changed-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.compute.manager [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Refreshing instance network info cache due to event network-changed-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] Acquiring lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updating instance_info_cache with network_info: [{"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Releasing lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Instance network_info: |[{"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] Acquired lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Refreshing network info cache for port 9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:23:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updated VIF entry in instance network info cache for port 9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:23:01 user nova-compute[72929]: DEBUG nova.network.neutron [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updating instance_info_cache with network_info: [{"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fc4b0cc1-3321-47af-babc-0bee0c4a9797 req-9b2ef08e-3fdc-432e-b6e3-0c74d03d98a3 service nova] Releasing lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG os_brick.utils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2f7d1e-3483-4199-bebd-bcf76e96808c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a0f8eb-12a3-4534-9005-77c1c81a2b78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2feb8c1-5e44-403e-b7dd-4921998f094c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff3d3b7-365c-4cba-ad47-40fe3dbd5540]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:23:04 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:23:04 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[621fff81-998e-4acc-9626-7fdebd2f58e8]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG os_brick.utils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:23:04 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updating existing volume attachment record: e62a4961-4301-4b26-947a-ed3380c99c72 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:23:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:23:10 user nova-compute[72929]: INFO nova.compute.claims [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Claim successful on node user
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:23:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:23:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Creating image(s)
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "/opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "/opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "/opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG nova.policy [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2193ffd5ecf94c8488e0bd4ff0ac1f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59274669d3f243ae85a3df4324f00349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.201s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.225s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk 1073741824" returned: 0 in 0.062s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.202s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Cannot resize image /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Ensure instance console log exists: /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:12 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Successfully created port: 0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Successfully updated port: 0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "refresh_cache-2efecb76-18e1-46b5-81a1-c54fc6bb74c2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquired lock "refresh_cache-2efecb76-18e1-46b5-81a1-c54fc6bb74c2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-changed-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Refreshing instance network info cache due to event network-changed-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:23:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] Acquiring lock "refresh_cache-2efecb76-18e1-46b5-81a1-c54fc6bb74c2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.neutron [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Updating instance_info_cache with network_info: [{"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Releasing lock "refresh_cache-2efecb76-18e1-46b5-81a1-c54fc6bb74c2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Instance network_info: |[{"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] Acquired lock "refresh_cache-2efecb76-18e1-46b5-81a1-c54fc6bb74c2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Refreshing network info cache for port 0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Start _get_guest_xml network_info=[{"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:23:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:14 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-716752313',display_name='tempest-VolumesNegativeTest-instance-716752313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-716752313',id=44,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59274669d3f243ae85a3df4324f00349',ramdisk_id='',reservation_id='r-a0zjn08l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-965182386',owner_user_name='tempest-VolumesNegativeTest-965182386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:23:11Z,user_data=None,user_id='2193ffd5ecf94c8488e0bd4ff0ac1f49',uuid=2efecb76-18e1-46b5-81a1-c54fc6bb74c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Converting VIF {"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lazy-loading 'pci_devices' on Instance uuid 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:23:14 user nova-compute[72929]:   <uuid>2efecb76-18e1-46b5-81a1-c54fc6bb74c2</uuid>
Aug 26 22:23:14 user nova-compute[72929]:   <name>instance-0000002c</name>
Aug 26 22:23:14 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:23:14 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:23:14 user nova-compute[72929]:   <metadata>
Aug 26 22:23:14 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:23:14 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:23:14 user nova-compute[72929]:       <nova:name>tempest-VolumesNegativeTest-instance-716752313</nova:name>
Aug 26 22:23:14 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:23:14</nova:creationTime>
Aug 26 22:23:14 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:23:14 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:23:14 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:23:14 user nova-compute[72929]:       <nova:owner>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:user uuid="2193ffd5ecf94c8488e0bd4ff0ac1f49">tempest-VolumesNegativeTest-965182386-project-member</nova:user>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:project uuid="59274669d3f243ae85a3df4324f00349">tempest-VolumesNegativeTest-965182386</nova:project>
Aug 26 22:23:14 user nova-compute[72929]:       </nova:owner>
Aug 26 22:23:14 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:23:14 user nova-compute[72929]:       <nova:ports>
Aug 26 22:23:14 user nova-compute[72929]:         <nova:port uuid="0b35a5aa-2edd-4fec-9b92-b1d7a5f24583">
Aug 26 22:23:14 user nova-compute[72929]:           <nova:ip type="fixed" address="192.168.233.93" ipVersion="4"/>
Aug 26 22:23:14 user nova-compute[72929]:         </nova:port>
Aug 26 22:23:14 user nova-compute[72929]:       </nova:ports>
Aug 26 22:23:14 user nova-compute[72929]:     </nova:instance>
Aug 26 22:23:14 user nova-compute[72929]:   </metadata>
Aug 26 22:23:14 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:23:14 user nova-compute[72929]:     <system>
Aug 26 22:23:14 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:23:14 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:23:14 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:23:14 user nova-compute[72929]:       <entry name="serial">2efecb76-18e1-46b5-81a1-c54fc6bb74c2</entry>
Aug 26 22:23:14 user nova-compute[72929]:       <entry name="uuid">2efecb76-18e1-46b5-81a1-c54fc6bb74c2</entry>
Aug 26 22:23:14 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:23:14 user nova-compute[72929]:     </system>
Aug 26 22:23:14 user nova-compute[72929]:   </sysinfo>
Aug 26 22:23:14 user nova-compute[72929]:   <os>
Aug 26 22:23:14 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:23:14 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:23:14 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:23:14 user nova-compute[72929]:   </os>
Aug 26 22:23:14 user nova-compute[72929]:   <features>
Aug 26 22:23:14 user nova-compute[72929]:     <acpi/>
Aug 26 22:23:14 user nova-compute[72929]:     <apic/>
Aug 26 22:23:14 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:23:14 user nova-compute[72929]:   </features>
Aug 26 22:23:14 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:23:14 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:23:14 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:23:14 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:23:14 user nova-compute[72929]:   </clock>
Aug 26 22:23:14 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:23:14 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:23:14 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:23:14 user nova-compute[72929]:   </cpu>
Aug 26 22:23:14 user nova-compute[72929]:   <devices>
Aug 26 22:23:14 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:23:14 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:23:14 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk"/>
Aug 26 22:23:14 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:23:14 user nova-compute[72929]:     </disk>
Aug 26 22:23:14 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:23:14 user nova-compute[72929]:       <mac address="fa:16:3e:d2:26:42"/>
Aug 26 22:23:14 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:14 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:23:14 user nova-compute[72929]:       <target dev="tap0b35a5aa-2e"/>
Aug 26 22:23:14 user nova-compute[72929]:     </interface>
Aug 26 22:23:14 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:23:14 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/console.log" append="off"/>
Aug 26 22:23:14 user nova-compute[72929]:     </serial>
Aug 26 22:23:14 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:23:14 user nova-compute[72929]:     <video>
Aug 26 22:23:14 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:14 user nova-compute[72929]:     </video>
Aug 26 22:23:14 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:23:14 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:23:14 user nova-compute[72929]:     </rng>
Aug 26 22:23:14 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:23:14 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:23:14 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:23:14 user nova-compute[72929]:     </memballoon>
Aug 26 22:23:14 user nova-compute[72929]:   </devices>
Aug 26 22:23:14 user nova-compute[72929]: </domain>
Aug 26 22:23:14 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-716752313',display_name='tempest-VolumesNegativeTest-instance-716752313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-716752313',id=44,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59274669d3f243ae85a3df4324f00349',ramdisk_id='',reservation_id='r-a0zjn08l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-965182386',owner_user_name='tempest-VolumesNegativeTest-965182386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:23:11Z,user_data=None,user_id='2193ffd5ecf94c8488e0bd4ff0ac1f49',uuid=2efecb76-18e1-46b5-81a1-c54fc6bb74c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Converting VIF {"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG os_vif [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b35a5aa-2e, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b35a5aa-2e, col_values=(('external_ids', {'iface-id': '0b35a5aa-2edd-4fec-9b92-b1d7a5f24583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:26:42', 'vm-uuid': '2efecb76-18e1-46b5-81a1-c54fc6bb74c2'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:14 user nova-compute[72929]: INFO os_vif [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e')
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] No VIF found with MAC fa:16:3e:d2:26:42, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Updated VIF entry in instance network info cache for port 0b35a5aa-2edd-4fec-9b92-b1d7a5f24583. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG nova.network.neutron [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Updating instance_info_cache with network_info: [{"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-09109292-aa8a-475e-8552-34970fc9584e req-81945974-ebb2-4a8e-a78b-662c3ce8aa5d service nova] Releasing lock "refresh_cache-2efecb76-18e1-46b5-81a1-c54fc6bb74c2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-e7dd1555-6339-4791-bbff-1820db2c787a req-cf388766-0dc6-4f90-8df0-8890fc9c2578 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e7dd1555-6339-4791-bbff-1820db2c787a req-cf388766-0dc6-4f90-8df0-8890fc9c2578 service nova] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e7dd1555-6339-4791-bbff-1820db2c787a req-cf388766-0dc6-4f90-8df0-8890fc9c2578 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e7dd1555-6339-4791-bbff-1820db2c787a req-cf388766-0dc6-4f90-8df0-8890fc9c2578 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-e7dd1555-6339-4791-bbff-1820db2c787a req-cf388766-0dc6-4f90-8df0-8890fc9c2578 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] No waiting events found dispatching network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:16 user nova-compute[72929]: WARNING nova.compute.manager [req-e7dd1555-6339-4791-bbff-1820db2c787a req-cf388766-0dc6-4f90-8df0-8890fc9c2578 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received unexpected event network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 for instance with vm_state building and task_state spawning.
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:23:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Creating image(s)
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Ensure instance console log exists: /opt/stack/data/nova/instances/5b6929c4-05b4-45eb-b23b-fc39b22d325e/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Start _get_guest_xml network_info=[{"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T22:22:44Z,direct_url=<?>,disk_format='qcow2',id=7fb9eba4-13bd-4b35-a8c4-e90bca733232,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2047817988',owner='ea6b106b16484bfa8fd629b57527130f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T22:22:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'e62a4961-4301-4b26-947a-ed3380c99c72', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKlPDXen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5b6929c4-05b4-45eb-b23b-fc39b22d325e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bccfe8f5-7afb-4b1b-92f8-a349efa5f118', 'serial': 'bccfe8f5-7afb-4b1b-92f8-a349efa5f118'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:23:16 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:16 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-26T22:22:44Z,direct_url=<?>,disk_format='qcow2',id=7fb9eba4-13bd-4b35-a8c4-e90bca733232,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2047817988',owner='ea6b106b16484bfa8fd629b57527130f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-26T22:22:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKlPDXen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:23:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:23:16 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:23:16 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c39c9-b2fd-4cb0-bac4-a5926be38e13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:23:16 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237ada8-f3ce-4d87-9fbe-71d3962cdca9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118] added
Aug 26 22:23:16 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:16 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9c385-7a55-44fc-af4d-659aaa9b93f6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeeb775-c8d9-41e1-9f30-ae1ecbd37c1f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKlPDXen {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IKlPDXen" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f064c-049d-48c0-90d5-f703a72161d8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IKlPDXen'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23fb518-5e34-4d8e-aa90-2214f1d58d72]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d0b17-b3d6-4c9f-8b8e-0a0ffbc29b64]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:23:17 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:23:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:23:17 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:23:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[738c17b6-1b87-431d-8078-aa2d80632e54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260]
Aug 26 22:23:17 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260] successful.
Aug 26 22:23:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ff0d6-44c9-47db-b860-aa2d72ddff06]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4cdae7-5f66-47b0-90b9-2b74058ac4db]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:23:17 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:23:17 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:23:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:23:17 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:23:17 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:23:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15e2381-528a-44e4-bc90-d91e6b1e77ea]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:23:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKlPDXen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23261323231666166', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261323231666166', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088598.2929623, 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] VM Resumed (Lifecycle Event)
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Instance spawned successfully.
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1049701019',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1049701019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1049701019',id=43,image_ref='7fb9eba4-13bd-4b35-a8c4-e90bca733232',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnoZoJ+8mejfijxqCUxAG1CKgWzv4BHXIF4C8UhHFYA3I4eajSzlzyzu8LdiJBlp+Ls4A2gcfnj34rm9IHSPP8t92bf5ypHK3p+AybZAddf7Asefjeu6py74Ew1zVI4/Q==',key_name='tempest-keypair-458942490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-t88iqugy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1716061349',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:22:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf31c30629f7485a9b160f8d853096dc',uuid=5b6929c4-05b4-45eb-b23b-fc39b22d325e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b6929c4-05b4-45eb-b23b-fc39b22d325e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:23:18 user nova-compute[72929]:   <uuid>5b6929c4-05b4-45eb-b23b-fc39b22d325e</uuid>
Aug 26 22:23:18 user nova-compute[72929]:   <name>instance-0000002b</name>
Aug 26 22:23:18 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:23:18 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:23:18 user nova-compute[72929]:   <metadata>
Aug 26 22:23:18 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:23:18 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:23:18 user nova-compute[72929]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1049701019</nova:name>
Aug 26 22:23:18 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:23:16</nova:creationTime>
Aug 26 22:23:18 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:23:18 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:23:18 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:23:18 user nova-compute[72929]:       <nova:owner>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:user uuid="cf31c30629f7485a9b160f8d853096dc">tempest-TestVolumeBootPattern-1716061349-project-member</nova:user>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:project uuid="ea6b106b16484bfa8fd629b57527130f">tempest-TestVolumeBootPattern-1716061349</nova:project>
Aug 26 22:23:18 user nova-compute[72929]:       </nova:owner>
Aug 26 22:23:18 user nova-compute[72929]:       <nova:root type="image" uuid="7fb9eba4-13bd-4b35-a8c4-e90bca733232"/>
Aug 26 22:23:18 user nova-compute[72929]:       <nova:ports>
Aug 26 22:23:18 user nova-compute[72929]:         <nova:port uuid="9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f">
Aug 26 22:23:18 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 22:23:18 user nova-compute[72929]:         </nova:port>
Aug 26 22:23:18 user nova-compute[72929]:       </nova:ports>
Aug 26 22:23:18 user nova-compute[72929]:     </nova:instance>
Aug 26 22:23:18 user nova-compute[72929]:   </metadata>
Aug 26 22:23:18 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:23:18 user nova-compute[72929]:     <system>
Aug 26 22:23:18 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:23:18 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:23:18 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:23:18 user nova-compute[72929]:       <entry name="serial">5b6929c4-05b4-45eb-b23b-fc39b22d325e</entry>
Aug 26 22:23:18 user nova-compute[72929]:       <entry name="uuid">5b6929c4-05b4-45eb-b23b-fc39b22d325e</entry>
Aug 26 22:23:18 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:23:18 user nova-compute[72929]:     </system>
Aug 26 22:23:18 user nova-compute[72929]:   </sysinfo>
Aug 26 22:23:18 user nova-compute[72929]:   <os>
Aug 26 22:23:18 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:23:18 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:23:18 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:23:18 user nova-compute[72929]:   </os>
Aug 26 22:23:18 user nova-compute[72929]:   <features>
Aug 26 22:23:18 user nova-compute[72929]:     <acpi/>
Aug 26 22:23:18 user nova-compute[72929]:     <apic/>
Aug 26 22:23:18 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:23:18 user nova-compute[72929]:   </features>
Aug 26 22:23:18 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:23:18 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:23:18 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:23:18 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:23:18 user nova-compute[72929]:   </clock>
Aug 26 22:23:18 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:23:18 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:23:18 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:23:18 user nova-compute[72929]:   </cpu>
Aug 26 22:23:18 user nova-compute[72929]:   <devices>
Aug 26 22:23:18 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:23:18 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:23:18 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:23:18 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:23:18 user nova-compute[72929]:       <serial>bccfe8f5-7afb-4b1b-92f8-a349efa5f118</serial>
Aug 26 22:23:18 user nova-compute[72929]:     </disk>
Aug 26 22:23:18 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:23:18 user nova-compute[72929]:       <mac address="fa:16:3e:02:7c:43"/>
Aug 26 22:23:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:18 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:23:18 user nova-compute[72929]:       <target dev="tap9f1fa2c0-81"/>
Aug 26 22:23:18 user nova-compute[72929]:     </interface>
Aug 26 22:23:18 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:23:18 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/5b6929c4-05b4-45eb-b23b-fc39b22d325e/console.log" append="off"/>
Aug 26 22:23:18 user nova-compute[72929]:     </serial>
Aug 26 22:23:18 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:23:18 user nova-compute[72929]:     <video>
Aug 26 22:23:18 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:18 user nova-compute[72929]:     </video>
Aug 26 22:23:18 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:23:18 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:23:18 user nova-compute[72929]:     </rng>
Aug 26 22:23:18 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:23:18 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:23:18 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:23:18 user nova-compute[72929]:     </memballoon>
Aug 26 22:23:18 user nova-compute[72929]:   </devices>
Aug 26 22:23:18 user nova-compute[72929]: </domain>
Aug 26 22:23:18 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1049701019',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1049701019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1049701019',id=43,image_ref='7fb9eba4-13bd-4b35-a8c4-e90bca733232',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnoZoJ+8mejfijxqCUxAG1CKgWzv4BHXIF4C8UhHFYA3I4eajSzlzyzu8LdiJBlp+Ls4A2gcfnj34rm9IHSPP8t92bf5ypHK3p+AybZAddf7Asefjeu6py74Ew1zVI4/Q==',key_name='tempest-keypair-458942490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-t88iqugy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1716061349',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:22:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf31c30629f7485a9b160f8d853096dc',uuid=5b6929c4-05b4-45eb-b23b-fc39b22d325e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG os_vif [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f1fa2c0-81, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f1fa2c0-81, col_values=(('external_ids', {'iface-id': '9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:7c:43', 'vm-uuid': '5b6929c4-05b4-45eb-b23b-fc39b22d325e'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088598.2949104, 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] VM Started (Lifecycle Event)
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:18 user nova-compute[72929]: INFO os_vif [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81')
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No VIF found with MAC fa:16:3e:02:7c:43, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-79d8fa99-a48f-4a12-a322-fe6a1f18dcde req-4e892c5b-ec52-4e1c-a0d9-48ae3bd7ee86 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-79d8fa99-a48f-4a12-a322-fe6a1f18dcde req-4e892c5b-ec52-4e1c-a0d9-48ae3bd7ee86 service nova] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-79d8fa99-a48f-4a12-a322-fe6a1f18dcde req-4e892c5b-ec52-4e1c-a0d9-48ae3bd7ee86 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-79d8fa99-a48f-4a12-a322-fe6a1f18dcde req-4e892c5b-ec52-4e1c-a0d9-48ae3bd7ee86 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-79d8fa99-a48f-4a12-a322-fe6a1f18dcde req-4e892c5b-ec52-4e1c-a0d9-48ae3bd7ee86 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] No waiting events found dispatching network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:18 user nova-compute[72929]: WARNING nova.compute.manager [req-79d8fa99-a48f-4a12-a322-fe6a1f18dcde req-4e892c5b-ec52-4e1c-a0d9-48ae3bd7ee86 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received unexpected event network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 for instance with vm_state building and task_state spawning.
Aug 26 22:23:18 user nova-compute[72929]: INFO nova.compute.manager [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Took 7.81 seconds to build instance.
Aug 26 22:23:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e7f9c604-68c7-4524-8c05-e99df4dfdcb8 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.911s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-e19f4c5b-77c5-4daf-b58a-93d07d7eb194 req-17d65f4e-f0b1-4189-82c3-313fef06bd96 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e19f4c5b-77c5-4daf-b58a-93d07d7eb194 req-17d65f4e-f0b1-4189-82c3-313fef06bd96 service nova] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e19f4c5b-77c5-4daf-b58a-93d07d7eb194 req-17d65f4e-f0b1-4189-82c3-313fef06bd96 service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e19f4c5b-77c5-4daf-b58a-93d07d7eb194 req-17d65f4e-f0b1-4189-82c3-313fef06bd96 service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-e19f4c5b-77c5-4daf-b58a-93d07d7eb194 req-17d65f4e-f0b1-4189-82c3-313fef06bd96 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] No waiting events found dispatching network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:20 user nova-compute[72929]: WARNING nova.compute.manager [req-e19f4c5b-77c5-4daf-b58a-93d07d7eb194 req-17d65f4e-f0b1-4189-82c3-313fef06bd96 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received unexpected event network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f for instance with vm_state building and task_state spawning.
Aug 26 22:23:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088602.135312, 5b6929c4-05b4-45eb-b23b-fc39b22d325e => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] VM Resumed (Lifecycle Event)
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Instance spawned successfully.
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088602.1360703, 5b6929c4-05b4-45eb-b23b-fc39b22d325e => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] VM Started (Lifecycle Event)
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Took 5.39 seconds to spawn the instance on the hypervisor.
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-b202f8fd-ea10-4aeb-8cd5-30ca283117b7 req-34bb0831-b5ed-4dca-86d3-ed0db02655ff service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b202f8fd-ea10-4aeb-8cd5-30ca283117b7 req-34bb0831-b5ed-4dca-86d3-ed0db02655ff service nova] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b202f8fd-ea10-4aeb-8cd5-30ca283117b7 req-34bb0831-b5ed-4dca-86d3-ed0db02655ff service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b202f8fd-ea10-4aeb-8cd5-30ca283117b7 req-34bb0831-b5ed-4dca-86d3-ed0db02655ff service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-b202f8fd-ea10-4aeb-8cd5-30ca283117b7 req-34bb0831-b5ed-4dca-86d3-ed0db02655ff service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] No waiting events found dispatching network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:22 user nova-compute[72929]: WARNING nova.compute.manager [req-b202f8fd-ea10-4aeb-8cd5-30ca283117b7 req-34bb0831-b5ed-4dca-86d3-ed0db02655ff service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received unexpected event network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f for instance with vm_state building and task_state spawning.
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:22 user nova-compute[72929]: INFO nova.compute.manager [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Took 24.63 seconds to build instance.
Aug 26 22:23:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c0ae1c67-99e5-40e9-8c9b-92eb6f0205ce tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.760s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:23:28 user nova-compute[72929]: INFO nova.compute.claims [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Claim successful on node user
Aug 26 22:23:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:28 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:23:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.policy [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c1250b5ba63437bb762df331fd6a80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302aa381f3904125a45c479568f7533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:23:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Creating image(s)
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "/opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "/opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.205s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk 1073741824" returned: 0 in 0.065s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Successfully created port: cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.215s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:23:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Cannot resize image /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Ensure instance console log exists: /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:23:31 user nova-compute[72929]: INFO nova.compute.claims [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Claim successful on node user
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Successfully updated port: cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquired lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-changed-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Refreshing instance network info cache due to event network-changed-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] Acquiring lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating instance_info_cache with network_info: [{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.neutron [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:23:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Releasing lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Instance network_info: |[{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] Acquired lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.neutron [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Refreshing network info cache for port cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Start _get_guest_xml network_info=[{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:23:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:31 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-921785682',display_name='tempest-TestStampPattern-server-921785682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-921785682',id=45,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiaLbB2o5ogep87t7WRN4urPuEDh9KfODTmawEmQ/qu+koXzGTao7gJ3UDoNxVJWqJmt66x5jrC7LMSYWaF8J15hYRkFpmbiahmJyfRf5/bnTHh7hhMlqJUwHVXMCZF6g==',key_name='tempest-TestStampPattern-1421469942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302aa381f3904125a45c479568f7533c',ramdisk_id='',reservation_id='r-ud008q26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-396757775',owner_user_name='tempest-TestStampPattern-396757775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:23:29Z,user_data=None,user_id='3c1250b5ba63437bb762df331fd6a80a',uuid=8dd90429-8672-4c4f-b719-bb54921646f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converting VIF {"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:23:31 user nova-compute[72929]:   <uuid>8dd90429-8672-4c4f-b719-bb54921646f2</uuid>
Aug 26 22:23:31 user nova-compute[72929]:   <name>instance-0000002d</name>
Aug 26 22:23:31 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:23:31 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:23:31 user nova-compute[72929]:   <metadata>
Aug 26 22:23:31 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:23:31 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:23:31 user nova-compute[72929]:       <nova:name>tempest-TestStampPattern-server-921785682</nova:name>
Aug 26 22:23:31 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:23:31</nova:creationTime>
Aug 26 22:23:31 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:23:31 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:23:31 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:23:31 user nova-compute[72929]:       <nova:owner>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:user uuid="3c1250b5ba63437bb762df331fd6a80a">tempest-TestStampPattern-396757775-project-member</nova:user>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:project uuid="302aa381f3904125a45c479568f7533c">tempest-TestStampPattern-396757775</nova:project>
Aug 26 22:23:31 user nova-compute[72929]:       </nova:owner>
Aug 26 22:23:31 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:23:31 user nova-compute[72929]:       <nova:ports>
Aug 26 22:23:31 user nova-compute[72929]:         <nova:port uuid="cf6f6be2-e9c2-4e1f-8379-8bff3e253de3">
Aug 26 22:23:31 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 26 22:23:31 user nova-compute[72929]:         </nova:port>
Aug 26 22:23:31 user nova-compute[72929]:       </nova:ports>
Aug 26 22:23:31 user nova-compute[72929]:     </nova:instance>
Aug 26 22:23:31 user nova-compute[72929]:   </metadata>
Aug 26 22:23:31 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:23:31 user nova-compute[72929]:     <system>
Aug 26 22:23:31 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:23:31 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:23:31 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:23:31 user nova-compute[72929]:       <entry name="serial">8dd90429-8672-4c4f-b719-bb54921646f2</entry>
Aug 26 22:23:31 user nova-compute[72929]:       <entry name="uuid">8dd90429-8672-4c4f-b719-bb54921646f2</entry>
Aug 26 22:23:31 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:23:31 user nova-compute[72929]:     </system>
Aug 26 22:23:31 user nova-compute[72929]:   </sysinfo>
Aug 26 22:23:31 user nova-compute[72929]:   <os>
Aug 26 22:23:31 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:23:31 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:23:31 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:23:31 user nova-compute[72929]:   </os>
Aug 26 22:23:31 user nova-compute[72929]:   <features>
Aug 26 22:23:31 user nova-compute[72929]:     <acpi/>
Aug 26 22:23:31 user nova-compute[72929]:     <apic/>
Aug 26 22:23:31 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:23:31 user nova-compute[72929]:   </features>
Aug 26 22:23:31 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:23:31 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:23:31 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:23:31 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:23:31 user nova-compute[72929]:   </clock>
Aug 26 22:23:31 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:23:31 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:23:31 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:23:31 user nova-compute[72929]:   </cpu>
Aug 26 22:23:31 user nova-compute[72929]:   <devices>
Aug 26 22:23:31 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:23:31 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:23:31 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk"/>
Aug 26 22:23:31 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:23:31 user nova-compute[72929]:     </disk>
Aug 26 22:23:31 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:23:31 user nova-compute[72929]:       <mac address="fa:16:3e:3e:52:e3"/>
Aug 26 22:23:31 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:31 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:23:31 user nova-compute[72929]:       <target dev="tapcf6f6be2-e9"/>
Aug 26 22:23:31 user nova-compute[72929]:     </interface>
Aug 26 22:23:31 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:23:31 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/console.log" append="off"/>
Aug 26 22:23:31 user nova-compute[72929]:     </serial>
Aug 26 22:23:31 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:23:31 user nova-compute[72929]:     <video>
Aug 26 22:23:31 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:31 user nova-compute[72929]:     </video>
Aug 26 22:23:31 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:23:31 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:23:31 user nova-compute[72929]:     </rng>
Aug 26 22:23:31 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:23:31 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:23:31 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:23:31 user nova-compute[72929]:     </memballoon>
Aug 26 22:23:31 user nova-compute[72929]:   </devices>
Aug 26 22:23:31 user nova-compute[72929]: </domain>
Aug 26 22:23:31 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-921785682',display_name='tempest-TestStampPattern-server-921785682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-921785682',id=45,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiaLbB2o5ogep87t7WRN4urPuEDh9KfODTmawEmQ/qu+koXzGTao7gJ3UDoNxVJWqJmt66x5jrC7LMSYWaF8J15hYRkFpmbiahmJyfRf5/bnTHh7hhMlqJUwHVXMCZF6g==',key_name='tempest-TestStampPattern-1421469942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302aa381f3904125a45c479568f7533c',ramdisk_id='',reservation_id='r-ud008q26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-396757775',owner_user_name='tempest-TestStampPattern-396757775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:23:29Z,user_data=None,user_id='3c1250b5ba63437bb762df331fd6a80a',uuid=8dd90429-8672-4c4f-b719-bb54921646f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converting VIF {"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG os_vif [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf6f6be2-e9, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf6f6be2-e9, col_values=(('external_ids', {'iface-id': 'cf6f6be2-e9c2-4e1f-8379-8bff3e253de3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:52:e3', 'vm-uuid': '8dd90429-8672-4c4f-b719-bb54921646f2'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.policy [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '270ea6e7f5ac4e64874f9d7aaf211b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c59076b100394311b871aff3d8232639', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:31 user nova-compute[72929]: INFO os_vif [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9')
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:23:31 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Creating image(s)
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "/opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:31 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "/opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "/opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.093s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No VIF found with MAC fa:16:3e:3e:52:e3, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.231s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.network.neutron [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updated VIF entry in instance network info cache for port cf6f6be2-e9c2-4e1f-8379-8bff3e253de3. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.network.neutron [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating instance_info_cache with network_info: [{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-092c448b-519f-4446-ad27-e20eb9cf7b98 req-f04af268-03d2-4cf3-b6b7-f86d93ab70e6 service nova] Releasing lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk 1073741824" returned: 0 in 0.078s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.network.neutron [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Successfully created port: 32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.197s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Cannot resize image /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Ensure instance console log exists: /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:32 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-77767a7b-1c85-496c-8b6b-b87a998b4f18 req-16f0f1ea-64b3-49e6-9a54-9dedd7896417 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-77767a7b-1c85-496c-8b6b-b87a998b4f18 req-16f0f1ea-64b3-49e6-9a54-9dedd7896417 service nova] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-77767a7b-1c85-496c-8b6b-b87a998b4f18 req-16f0f1ea-64b3-49e6-9a54-9dedd7896417 service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-77767a7b-1c85-496c-8b6b-b87a998b4f18 req-16f0f1ea-64b3-49e6-9a54-9dedd7896417 service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-77767a7b-1c85-496c-8b6b-b87a998b4f18 req-16f0f1ea-64b3-49e6-9a54-9dedd7896417 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] No waiting events found dispatching network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:34 user nova-compute[72929]: WARNING nova.compute.manager [req-77767a7b-1c85-496c-8b6b-b87a998b4f18 req-16f0f1ea-64b3-49e6-9a54-9dedd7896417 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received unexpected event network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 for instance with vm_state building and task_state spawning.
Aug 26 22:23:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Successfully updated port: 32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquired lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.network.neutron [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088615.8675797, 8dd90429-8672-4c4f-b719-bb54921646f2 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] VM Resumed (Lifecycle Event)
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:23:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Instance spawned successfully.
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088615.8684685, 8dd90429-8672-4c4f-b719-bb54921646f2 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] VM Started (Lifecycle Event)
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:35 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:35 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:36 user nova-compute[72929]: INFO nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updating instance_info_cache with network_info: [{"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Releasing lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Instance network_info: |[{"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Start _get_guest_xml network_info=[{"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:23:36 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:36 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1517963679',display_name='tempest-VolumesSnapshotTestJSON-instance-1517963679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1517963679',id=46,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyr07IovVszNqwKOMFFN/dKalpwJI8Q4xu1X7pPjtgKAai8xf6aHp+Jbp3BDkdObRZ/vzE0xU1vA4Ex220IDQREOQwipRF3ovDNSgdoUq6fC9pGSoqUG9PQ1t0r90XZLw==',key_name='tempest-keypair-129539297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59076b100394311b871aff3d8232639',ramdisk_id='',reservation_id='r-evctfvur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1269723',owner_user_name='tempest-VolumesSnapshotTestJSON-1269723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270ea6e7f5ac4e64874f9d7aaf211b33',uuid=b70179ce-ad2d-419b-9e34-b9bb73ec5ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converting VIF {"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.objects.instance [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'pci_devices' on Instance uuid b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:23:36 user nova-compute[72929]: INFO nova.compute.manager [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Took 7.47 seconds to build instance.
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:23:36 user nova-compute[72929]:   <uuid>b70179ce-ad2d-419b-9e34-b9bb73ec5ea1</uuid>
Aug 26 22:23:36 user nova-compute[72929]:   <name>instance-0000002e</name>
Aug 26 22:23:36 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:23:36 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:23:36 user nova-compute[72929]:   <metadata>
Aug 26 22:23:36 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:23:36 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:23:36 user nova-compute[72929]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1517963679</nova:name>
Aug 26 22:23:36 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:23:36</nova:creationTime>
Aug 26 22:23:36 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:23:36 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:23:36 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:23:36 user nova-compute[72929]:       <nova:owner>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:user uuid="270ea6e7f5ac4e64874f9d7aaf211b33">tempest-VolumesSnapshotTestJSON-1269723-project-member</nova:user>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:project uuid="c59076b100394311b871aff3d8232639">tempest-VolumesSnapshotTestJSON-1269723</nova:project>
Aug 26 22:23:36 user nova-compute[72929]:       </nova:owner>
Aug 26 22:23:36 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:23:36 user nova-compute[72929]:       <nova:ports>
Aug 26 22:23:36 user nova-compute[72929]:         <nova:port uuid="32411ca9-563c-4bc0-a595-8c2e5abf4e88">
Aug 26 22:23:36 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 26 22:23:36 user nova-compute[72929]:         </nova:port>
Aug 26 22:23:36 user nova-compute[72929]:       </nova:ports>
Aug 26 22:23:36 user nova-compute[72929]:     </nova:instance>
Aug 26 22:23:36 user nova-compute[72929]:   </metadata>
Aug 26 22:23:36 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:23:36 user nova-compute[72929]:     <system>
Aug 26 22:23:36 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:23:36 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:23:36 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:23:36 user nova-compute[72929]:       <entry name="serial">b70179ce-ad2d-419b-9e34-b9bb73ec5ea1</entry>
Aug 26 22:23:36 user nova-compute[72929]:       <entry name="uuid">b70179ce-ad2d-419b-9e34-b9bb73ec5ea1</entry>
Aug 26 22:23:36 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:23:36 user nova-compute[72929]:     </system>
Aug 26 22:23:36 user nova-compute[72929]:   </sysinfo>
Aug 26 22:23:36 user nova-compute[72929]:   <os>
Aug 26 22:23:36 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:23:36 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:23:36 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:23:36 user nova-compute[72929]:   </os>
Aug 26 22:23:36 user nova-compute[72929]:   <features>
Aug 26 22:23:36 user nova-compute[72929]:     <acpi/>
Aug 26 22:23:36 user nova-compute[72929]:     <apic/>
Aug 26 22:23:36 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:23:36 user nova-compute[72929]:   </features>
Aug 26 22:23:36 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:23:36 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:23:36 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:23:36 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:23:36 user nova-compute[72929]:   </clock>
Aug 26 22:23:36 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:23:36 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:23:36 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:23:36 user nova-compute[72929]:   </cpu>
Aug 26 22:23:36 user nova-compute[72929]:   <devices>
Aug 26 22:23:36 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:23:36 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:23:36 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk"/>
Aug 26 22:23:36 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:23:36 user nova-compute[72929]:     </disk>
Aug 26 22:23:36 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:23:36 user nova-compute[72929]:       <mac address="fa:16:3e:7b:69:b5"/>
Aug 26 22:23:36 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:36 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:23:36 user nova-compute[72929]:       <target dev="tap32411ca9-56"/>
Aug 26 22:23:36 user nova-compute[72929]:     </interface>
Aug 26 22:23:36 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:23:36 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/console.log" append="off"/>
Aug 26 22:23:36 user nova-compute[72929]:     </serial>
Aug 26 22:23:36 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:23:36 user nova-compute[72929]:     <video>
Aug 26 22:23:36 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:23:36 user nova-compute[72929]:     </video>
Aug 26 22:23:36 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:23:36 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:23:36 user nova-compute[72929]:     </rng>
Aug 26 22:23:36 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:23:36 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:23:36 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:23:36 user nova-compute[72929]:     </memballoon>
Aug 26 22:23:36 user nova-compute[72929]:   </devices>
Aug 26 22:23:36 user nova-compute[72929]: </domain>
Aug 26 22:23:36 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1517963679',display_name='tempest-VolumesSnapshotTestJSON-instance-1517963679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1517963679',id=46,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyr07IovVszNqwKOMFFN/dKalpwJI8Q4xu1X7pPjtgKAai8xf6aHp+Jbp3BDkdObRZ/vzE0xU1vA4Ex220IDQREOQwipRF3ovDNSgdoUq6fC9pGSoqUG9PQ1t0r90XZLw==',key_name='tempest-keypair-129539297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c59076b100394311b871aff3d8232639',ramdisk_id='',reservation_id='r-evctfvur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1269723',owner_user_name='tempest-VolumesSnapshotTestJSON-1269723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:23:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270ea6e7f5ac4e64874f9d7aaf211b33',uuid=b70179ce-ad2d-419b-9e34-b9bb73ec5ea1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converting VIF {"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG os_vif [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4bd8e2fc-d662-429c-9ec2-06829eecd6e9 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.604s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32411ca9-56, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32411ca9-56, col_values=(('external_ids', {'iface-id': '32411ca9-563c-4bc0-a595-8c2e5abf4e88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:69:b5', 'vm-uuid': 'b70179ce-ad2d-419b-9e34-b9bb73ec5ea1'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:36 user nova-compute[72929]: INFO os_vif [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56')
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No VIF found with MAC fa:16:3e:7b:69:b5, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] No waiting events found dispatching network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:36 user nova-compute[72929]: WARNING nova.compute.manager [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received unexpected event network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 for instance with vm_state active and task_state None.
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-changed-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Refreshing instance network info cache due to event network-changed-32411ca9-563c-4bc0-a595-8c2e5abf4e88. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] Acquiring lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] Acquired lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.neutron [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Refreshing network info cache for port 32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Skipping network cache update for instance because it is Building. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:23:36 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updated VIF entry in instance network info cache for port 32411ca9-563c-4bc0-a595-8c2e5abf4e88. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updating instance_info_cache with network_info: [{"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5a13fd7c-8b30-4fcd-84fe-93f50a5896c6 req-dfcff8c1-4c69-4011-977d-1de15ffd99d2 service nova] Releasing lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8ddba0d-8e59-465b-adca-472d47810108 req-3ced949a-3a8a-4e21-8a67-28f12673844e service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8ddba0d-8e59-465b-adca-472d47810108 req-3ced949a-3a8a-4e21-8a67-28f12673844e service nova] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8ddba0d-8e59-465b-adca-472d47810108 req-3ced949a-3a8a-4e21-8a67-28f12673844e service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d8ddba0d-8e59-465b-adca-472d47810108 req-3ced949a-3a8a-4e21-8a67-28f12673844e service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-d8ddba0d-8e59-465b-adca-472d47810108 req-3ced949a-3a8a-4e21-8a67-28f12673844e service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] No waiting events found dispatching network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:37 user nova-compute[72929]: WARNING nova.compute.manager [req-d8ddba0d-8e59-465b-adca-472d47810108 req-3ced949a-3a8a-4e21-8a67-28f12673844e service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received unexpected event network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 for instance with vm_state building and task_state spawning.
Aug 26 22:23:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:23:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088619.7330794, b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] VM Resumed (Lifecycle Event)
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:39 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Instance spawned successfully.
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:23:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088619.7449677, b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:23:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] VM Started (Lifecycle Event)
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:23:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:23:39 user nova-compute[72929]: INFO nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Took 8.02 seconds to spawn the instance on the hypervisor.
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG nova.compute.manager [req-cff4ebf5-0a3e-4a2f-b7e6-7db040f9a8fe req-f41176f7-c14f-4fa5-92ec-3e5eaa1a3135 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cff4ebf5-0a3e-4a2f-b7e6-7db040f9a8fe req-f41176f7-c14f-4fa5-92ec-3e5eaa1a3135 service nova] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cff4ebf5-0a3e-4a2f-b7e6-7db040f9a8fe req-f41176f7-c14f-4fa5-92ec-3e5eaa1a3135 service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cff4ebf5-0a3e-4a2f-b7e6-7db040f9a8fe req-f41176f7-c14f-4fa5-92ec-3e5eaa1a3135 service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:40 user nova-compute[72929]: DEBUG nova.compute.manager [req-cff4ebf5-0a3e-4a2f-b7e6-7db040f9a8fe req-f41176f7-c14f-4fa5-92ec-3e5eaa1a3135 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] No waiting events found dispatching network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:23:40 user nova-compute[72929]: WARNING nova.compute.manager [req-cff4ebf5-0a3e-4a2f-b7e6-7db040f9a8fe req-f41176f7-c14f-4fa5-92ec-3e5eaa1a3135 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received unexpected event network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 for instance with vm_state building and task_state spawning.
Aug 26 22:23:40 user nova-compute[72929]: INFO nova.compute.manager [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Took 9.08 seconds to build instance.
Aug 26 22:23:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-099eec70-47c5-4bda-9617-396c6aa8eb89 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.189s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:23:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:23:41 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:41 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=23.94959259033203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5be90001-c03f-466e-a8d1-bc167da12cc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 6426d900-d9c6-464e-aac3-a22392b39f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5b6929c4-05b4-45eb-b23b-fc39b22d325e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:23:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.857s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:23:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_power_states {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 5be90001-c03f-466e-a8d1-bc167da12cc9 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 83ba3bb1-8898-4e12-ac70-84c2c028dbcc {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 5b6929c4-05b4-45eb-b23b-fc39b22d325e {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:23:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:23:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:51 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:23:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:23:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:23:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:23:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:24:02 user nova-compute[72929]: INFO nova.compute.manager [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] instance snapshotting
Aug 26 22:24:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Beginning live snapshot process
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3l01mvd3/cf856a73c6e94614b83f8d69e3133894.delta 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3l01mvd3/cf856a73c6e94614b83f8d69e3133894.delta 1073741824" returned: 0 in 0.071s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:03 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 22:24:04 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:24:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:24:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 22:24:05 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:24:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3l01mvd3/cf856a73c6e94614b83f8d69e3133894.delta /opt/stack/data/nova/instances/snapshots/tmp3l01mvd3/cf856a73c6e94614b83f8d69e3133894 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3l01mvd3/cf856a73c6e94614b83f8d69e3133894.delta /opt/stack/data/nova/instances/snapshots/tmp3l01mvd3/cf856a73c6e94614b83f8d69e3133894" returned: 0 in 0.592s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Snapshot extracted, beginning image upload
Aug 26 22:24:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:08 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Snapshot image upload complete
Aug 26 22:24:08 user nova-compute[72929]: INFO nova.compute.manager [None req-976efe64-2e9b-4def-bba0-6c5d18867482 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Took 5.11 seconds to snapshot the instance on the hypervisor.
Aug 26 22:24:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'flavor' on Instance uuid 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:10 user nova-compute[72929]: INFO nova.compute.manager [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Attaching volume fbd29d77-87ec-4f06-9834-962effaf8daf to /dev/vdb
Aug 26 22:24:10 user nova-compute[72929]: DEBUG os_brick.utils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab41294-4136-40cb-b73a-6210ae6aac3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cefdfe3-c692-40b1-a3ac-b39d69874854]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b95780-da69-4d27-b40c-db14c79a2f3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d862d6-6d8d-4852-92e4-e295994ff239]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:24:10 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:24:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba01a1b-b2d6-4c44-afe0-59ea992fc0cf]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG os_brick.utils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:24:10 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating existing volume attachment record: 680b6035-5bde-4792-a563-15f81d1cbc47 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:24:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:24:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:24:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:24:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:24:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWpnqfHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:24:21 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:24:21 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:24:21 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cbe617-ac6a-4ba0-9df1-5161ccf11c91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:24:21 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba67003-e215-430f-b83a-5abd1d5d3160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf] added
Aug 26 22:24:21 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a141fd-32be-4217-9822-59f86bac1b98]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0139047-89c0-4436-a990-a5034d26f7c8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWpnqfHR {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sWpnqfHR" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfca6126-9da2-43f6-863e-a67fcfd80567]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sWpnqfHR'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5ffda0-c4fa-46c4-b983-3e7cc09d85e1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2d62bb-f08a-4e67-adee-c216b88421f6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:24:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:24:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[096f9e1c-e6e0-4ffe-a989-4440f13ef70a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260]
Aug 26 22:24:22 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260] successful.
Aug 26 22:24:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92477c4-95da-4394-b711-d0357ea951e3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a63e6-7165-49d8-a177-e258fc525e7e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:24:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:24:22 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:24:22 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff663113-f7d4-48b7-a2bc-3a67db9e094a]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:22 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWpnqfHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26561343662633532', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561343662633532', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG nova.objects.instance [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'flavor' on Instance uuid 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:24:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:24:23 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:24:23 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:24:23 user nova-compute[72929]:   <serial>fbd29d77-87ec-4f06-9834-962effaf8daf</serial>
Aug 26 22:24:23 user nova-compute[72929]: </disk>
Aug 26 22:24:23 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] No VIF found with MAC fa:16:3e:79:55:7f, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:24:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-905a34df-63c5-4255-9c2c-5067f154f6ef tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.392s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing instance network info cache due to event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG nova.network.neutron [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG nova.network.neutron [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updated VIF entry in instance network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG nova.network.neutron [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:24:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bdca2a23-c069-4fe4-aa08-4e7ceb53f848 req-a76779a7-0b29-4494-80b5-db14163614d0 service nova] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:24:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG nova.compute.manager [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing instance network info cache due to event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updated VIF entry in instance network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG nova.network.neutron [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a4628edb-e685-4763-b2d9-8feb670971db req-bf1c2d60-b6be-4519-ba43-ee07fe2b212e service nova] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:29 user nova-compute[72929]: INFO nova.compute.manager [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Rebooting instance
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:24:29 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:24:30 user nova-compute[72929]: DEBUG nova.network.neutron [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:24:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:24:30 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:24:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-a7de7ed2-486a-4bed-9b7a-0166ab2aaa2d req-90c84648-1708-4a4d-ae8c-6c26d6203bf9 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-unplugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a7de7ed2-486a-4bed-9b7a-0166ab2aaa2d req-90c84648-1708-4a4d-ae8c-6c26d6203bf9 service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a7de7ed2-486a-4bed-9b7a-0166ab2aaa2d req-90c84648-1708-4a4d-ae8c-6c26d6203bf9 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a7de7ed2-486a-4bed-9b7a-0166ab2aaa2d req-90c84648-1708-4a4d-ae8c-6c26d6203bf9 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-a7de7ed2-486a-4bed-9b7a-0166ab2aaa2d req-90c84648-1708-4a4d-ae8c-6c26d6203bf9 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-unplugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:24:33 user nova-compute[72929]: WARNING nova.compute.manager [req-a7de7ed2-486a-4bed-9b7a-0166ab2aaa2d req-90c84648-1708-4a4d-ae8c-6c26d6203bf9 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-unplugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state active and task_state reboot_started.
Aug 26 22:24:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:33 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance shutdown successfully.
Aug 26 22:24:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-8921b79d-7efb-4290-9693-ab4ac33a94b9 req-d02a9290-35e5-4ea9-b406-93df7e5f158b service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8921b79d-7efb-4290-9693-ab4ac33a94b9 req-d02a9290-35e5-4ea9-b406-93df7e5f158b service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8921b79d-7efb-4290-9693-ab4ac33a94b9 req-d02a9290-35e5-4ea9-b406-93df7e5f158b service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8921b79d-7efb-4290-9693-ab4ac33a94b9 req-d02a9290-35e5-4ea9-b406-93df7e5f158b service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG nova.compute.manager [req-8921b79d-7efb-4290-9693-ab4ac33a94b9 req-d02a9290-35e5-4ea9-b406-93df7e5f158b service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:24:35 user nova-compute[72929]: WARNING nova.compute.manager [req-8921b79d-7efb-4290-9693-ab4ac33a94b9 req-d02a9290-35e5-4ea9-b406-93df7e5f158b service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state active and task_state reboot_started.
Aug 26 22:24:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:36 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for 6426d900-d9c6-464e-aac3-a22392b39f9c due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088677.0177455, 6426d900-d9c6-464e-aac3-a22392b39f9c => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:24:37 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] VM Resumed (Lifecycle Event)
Aug 26 22:24:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance running successfully.
Aug 26 22:24:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance soft rebooted successfully.
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:24:37 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088677.0188415, 6426d900-d9c6-464e-aac3-a22392b39f9c => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:24:37 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] VM Started (Lifecycle Event)
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c61bdf77-5e02-46db-9f05-bc343514a046 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.125s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:24:37 user nova-compute[72929]: WARNING nova.compute.manager [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state active and task_state None.
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:24:37 user nova-compute[72929]: WARNING nova.compute.manager [req-1a05f8ae-fb16-44b7-b305-2253604ce338 req-0143cf2a-7617-4ded-93c2-4763a0f798c1 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state active and task_state None.
Aug 26 22:24:37 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:24:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:42 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:24:42 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7660MB free_disk=23.8331298828125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5be90001-c03f-466e-a8d1-bc167da12cc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 6426d900-d9c6-464e-aac3-a22392b39f9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5b6929c4-05b4-45eb-b23b-fc39b22d325e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:24:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:24:46 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-changed-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Refreshing instance network info cache due to event network-changed-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] Acquiring lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] Acquired lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:24:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Refreshing network info cache for port 9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:49 user nova-compute[72929]: INFO nova.compute.manager [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Terminating instance
Aug 26 22:24:49 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updated VIF entry in instance network info cache for port 9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updating instance_info_cache with network_info: [{"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c7505bde-ecbd-415f-a3dd-881bd44abcab req-787f58b8-8ea9-4c87-b04f-b8179a830db1 service nova] Releasing lock "refresh_cache-5b6929c4-05b4-45eb-b23b-fc39b22d325e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-fdd6ae0b-f96f-49bb-8bfc-9874b1d8637c req-143ad1e9-6940-43e5-90f2-1f5904aafe18 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-vif-unplugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fdd6ae0b-f96f-49bb-8bfc-9874b1d8637c req-143ad1e9-6940-43e5-90f2-1f5904aafe18 service nova] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fdd6ae0b-f96f-49bb-8bfc-9874b1d8637c req-143ad1e9-6940-43e5-90f2-1f5904aafe18 service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fdd6ae0b-f96f-49bb-8bfc-9874b1d8637c req-143ad1e9-6940-43e5-90f2-1f5904aafe18 service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-fdd6ae0b-f96f-49bb-8bfc-9874b1d8637c req-143ad1e9-6940-43e5-90f2-1f5904aafe18 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] No waiting events found dispatching network-vif-unplugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:24:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-fdd6ae0b-f96f-49bb-8bfc-9874b1d8637c req-143ad1e9-6940-43e5-90f2-1f5904aafe18 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-vif-unplugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:24:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Instance destroyed successfully.
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'resources' on Instance uuid 5b6929c4-05b4-45eb-b23b-fc39b22d325e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1049701019',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1049701019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1049701019',id=43,image_ref='7fb9eba4-13bd-4b35-a8c4-e90bca733232',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnoZoJ+8mejfijxqCUxAG1CKgWzv4BHXIF4C8UhHFYA3I4eajSzlzyzu8LdiJBlp+Ls4A2gcfnj34rm9IHSPP8t92bf5ypHK3p+AybZAddf7Asefjeu6py74Ew1zVI4/Q==',key_name='tempest-keypair-458942490',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:23:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-t88iqugy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1716061349',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf31c30629f7485a9b160f8d853096dc',uuid=5b6929c4-05b4-45eb-b23b-fc39b22d325e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "address": "fa:16:3e:02:7c:43", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f1fa2c0-81", "ovs_interfaceid": "9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_vif [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f1fa2c0-81, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:24:50 user nova-compute[72929]: INFO os_vif [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:7c:43,bridge_name='br-int',has_traffic_filtering=True,id=9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f1fa2c0-81')
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IKlPDXen', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:24:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16e5309-c2b6-48d2-9148-ac783f05e34a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea796153-33bf-4cc4-b94a-ce3d7eba6eaa]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:24:50 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:24:50 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:24:50 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:24:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:24:50 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:24:50 user nova-compute[72929]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 (non-flash)
Aug 26 22:24:50 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:24:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba68e09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ff98b9-3267-4eba-a36e-e069d6de16e9]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea073f18-40be-49d8-809a-05ec1c784c4b]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97f6f43-4a73-4b9a-a65e-7cf4203db9b4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d346ae-1d6d-4b30-a722-ff829fe1c02c]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23261323231666166', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_27c3e33d', '/dev/disk/by-id/scsi-1SCST_BIO27c3e33d-2a221faf202ac2aa') {{(pid=84150) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b576e5c6-2c96-43b9-9b12-0e574bc8dd1d]: (4, None) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115aca5-a5f7-465c-98af-65766683c0ae]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5293f876-b7ec-4f40-bad9-750c3c51eb58]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260]
Aug 26 22:24:50 user nova-compute[72929]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118, portal: 172.16.0.220,3260] successful.
Aug 26 22:24:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bccfe8f5-7afb-4b1b-92f8-a349efa5f118 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[14652e4e-96f0-483b-a553-2092d70c620d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== disconnect_volume: return (285ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:24:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Deleting instance files /opt/stack/data/nova/instances/5b6929c4-05b4-45eb-b23b-fc39b22d325e_del
Aug 26 22:24:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Deletion of /opt/stack/data/nova/instances/5b6929c4-05b4-45eb-b23b-fc39b22d325e_del complete
Aug 26 22:24:50 user nova-compute[72929]: INFO nova.compute.manager [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 26 22:24:50 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:24:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:24:51 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:24:51 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Took 0.91 seconds to deallocate network for instance.
Aug 26 22:24:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-5af113d2-d4ee-43aa-8d30-1576429e6d68 req-e305260b-ae95-43dd-a9a9-73d041524742 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-vif-deleted-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-e799e8b1-4151-44ca-9b5f-02ff1ab88875 req-8ef41e80-2c3e-438c-9abd-7f3dc22e1462 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received event network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:24:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e799e8b1-4151-44ca-9b5f-02ff1ab88875 req-8ef41e80-2c3e-438c-9abd-7f3dc22e1462 service nova] Acquiring lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e799e8b1-4151-44ca-9b5f-02ff1ab88875 req-8ef41e80-2c3e-438c-9abd-7f3dc22e1462 service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e799e8b1-4151-44ca-9b5f-02ff1ab88875 req-8ef41e80-2c3e-438c-9abd-7f3dc22e1462 service nova] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-e799e8b1-4151-44ca-9b5f-02ff1ab88875 req-8ef41e80-2c3e-438c-9abd-7f3dc22e1462 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] No waiting events found dispatching network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:24:51 user nova-compute[72929]: WARNING nova.compute.manager [req-e799e8b1-4151-44ca-9b5f-02ff1ab88875 req-8ef41e80-2c3e-438c-9abd-7f3dc22e1462 service nova] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Received unexpected event network-vif-plugged-9f1fa2c0-81a5-4f27-bba4-6b02cb54ef5f for instance with vm_state active and task_state deleting.
Aug 26 22:24:52 user nova-compute[72929]: INFO nova.compute.manager [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Took 0.90 seconds to detach 1 volumes for instance.
Aug 26 22:24:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Deleting volume: bccfe8f5-7afb-4b1b-92f8-a349efa5f118 {{(pid=72929) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 22:24:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:24:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:24:52 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:24:52 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:24:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:52 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Deleted allocations for instance 5b6929c4-05b4-45eb-b23b-fc39b22d325e
Aug 26 22:24:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b28180bb-0909-4bf8-8c86-b64443562549 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5b6929c4-05b4-45eb-b23b-fc39b22d325e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.516s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:24:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:24:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:01 user nova-compute[72929]: INFO nova.compute.manager [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Terminating instance
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.compute.manager [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-e8496800-806b-4deb-8da9-0b639b634d65 req-46c59099-e041-43cd-867e-05b42612a3d6 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-vif-unplugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e8496800-806b-4deb-8da9-0b639b634d65 req-46c59099-e041-43cd-867e-05b42612a3d6 service nova] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e8496800-806b-4deb-8da9-0b639b634d65 req-46c59099-e041-43cd-867e-05b42612a3d6 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-e8496800-806b-4deb-8da9-0b639b634d65 req-46c59099-e041-43cd-867e-05b42612a3d6 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-e8496800-806b-4deb-8da9-0b639b634d65 req-46c59099-e041-43cd-867e-05b42612a3d6 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] No waiting events found dispatching network-vif-unplugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-e8496800-806b-4deb-8da9-0b639b634d65 req-46c59099-e041-43cd-867e-05b42612a3d6 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-vif-unplugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:25:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Instance destroyed successfully.
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.objects.instance [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lazy-loading 'resources' on Instance uuid 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-716752313',display_name='tempest-VolumesNegativeTest-instance-716752313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-716752313',id=44,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59274669d3f243ae85a3df4324f00349',ramdisk_id='',reservation_id='r-a0zjn08l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-965182386',owner_user_name='tempest-VolumesNegativeTest-965182386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:23:19Z,user_data=None,user_id='2193ffd5ecf94c8488e0bd4ff0ac1f49',uuid=2efecb76-18e1-46b5-81a1-c54fc6bb74c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Converting VIF {"id": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "address": "fa:16:3e:d2:26:42", "network": {"id": "ea21f85f-6cba-4986-9e72-7a9dd2739c7f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ef4acd3cbba8442a9c306f53fe0c7067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b35a5aa-2e", "ovs_interfaceid": "0b35a5aa-2edd-4fec-9b92-b1d7a5f24583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG os_vif [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b35a5aa-2e, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:01 user nova-compute[72929]: INFO os_vif [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:26:42,bridge_name='br-int',has_traffic_filtering=True,id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583,network=Network(ea21f85f-6cba-4986-9e72-7a9dd2739c7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b35a5aa-2e')
Aug 26 22:25:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Deleting instance files /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2_del
Aug 26 22:25:01 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Deletion of /opt/stack/data/nova/instances/2efecb76-18e1-46b5-81a1-c54fc6bb74c2_del complete
Aug 26 22:25:01 user nova-compute[72929]: INFO nova.compute.manager [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 22:25:01 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:25:01 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:02 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Took 0.53 seconds to deallocate network for instance.
Aug 26 22:25:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-cb919fc9-c60d-4e10-b12d-04c25ba77c8e req-94a161cd-921a-4af8-b6ea-9255825047f7 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-vif-deleted-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:02 user nova-compute[72929]: INFO nova.compute.manager [req-cb919fc9-c60d-4e10-b12d-04c25ba77c8e req-94a161cd-921a-4af8-b6ea-9255825047f7 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Neutron deleted interface 0b35a5aa-2edd-4fec-9b92-b1d7a5f24583; detaching it from the instance and deleting it from the info cache
Aug 26 22:25:02 user nova-compute[72929]: DEBUG nova.network.neutron [req-cb919fc9-c60d-4e10-b12d-04c25ba77c8e req-94a161cd-921a-4af8-b6ea-9255825047f7 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-cb919fc9-c60d-4e10-b12d-04c25ba77c8e req-94a161cd-921a-4af8-b6ea-9255825047f7 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Detach interface failed, port_id=0b35a5aa-2edd-4fec-9b92-b1d7a5f24583, reason: Instance 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:25:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:02 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Deleted allocations for instance 2efecb76-18e1-46b5-81a1-c54fc6bb74c2
Aug 26 22:25:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-db72eabd-dbec-45af-b696-048fdfc9e6b6 tempest-VolumesNegativeTest-965182386 tempest-VolumesNegativeTest-965182386-project-member] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-3c28a44a-0c14-45b0-b035-afbd8a3d4c16 req-50f4dadc-c133-4e30-ab28-d10d605f5e94 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received event network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c28a44a-0c14-45b0-b035-afbd8a3d4c16 req-50f4dadc-c133-4e30-ab28-d10d605f5e94 service nova] Acquiring lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c28a44a-0c14-45b0-b035-afbd8a3d4c16 req-50f4dadc-c133-4e30-ab28-d10d605f5e94 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:03 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3c28a44a-0c14-45b0-b035-afbd8a3d4c16 req-50f4dadc-c133-4e30-ab28-d10d605f5e94 service nova] Lock "2efecb76-18e1-46b5-81a1-c54fc6bb74c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:03 user nova-compute[72929]: DEBUG nova.compute.manager [req-3c28a44a-0c14-45b0-b035-afbd8a3d4c16 req-50f4dadc-c133-4e30-ab28-d10d605f5e94 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] No waiting events found dispatching network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:25:03 user nova-compute[72929]: WARNING nova.compute.manager [req-3c28a44a-0c14-45b0-b035-afbd8a3d4c16 req-50f4dadc-c133-4e30-ab28-d10d605f5e94 service nova] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Received unexpected event network-vif-plugged-0b35a5aa-2edd-4fec-9b92-b1d7a5f24583 for instance with vm_state deleted and task_state None.
Aug 26 22:25:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:05 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088690.0133624, 5b6929c4-05b4-45eb-b23b-fc39b22d325e => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:25:05 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] VM Stopped (Lifecycle Event)
Aug 26 22:25:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c4fdb231-7226-4cbf-a2a5-d0e7a132c081 None None] [instance: 5b6929c4-05b4-45eb-b23b-fc39b22d325e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:25:06 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "b7993d49-af45-433e-8676-38ec3e12960f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:25:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:25:10 user nova-compute[72929]: INFO nova.compute.claims [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Claim successful on node user
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:25:11 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:25:11 user nova-compute[72929]: INFO nova.virt.block_device [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Booting with volume-backed-image 004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3 at /dev/vda
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.policy [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc2833663e85431fa3433a128520c8a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcc89a603c20492d9a2f41085f0e10f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:11 user nova-compute[72929]: DEBUG nova.network.neutron [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Successfully created port: 9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Successfully updated port: 9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-changed-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Refreshing instance network info cache due to event network-changed-9d101a1a-3dc1-493f-bbb9-649aabca0df7. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] Acquiring lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating instance_info_cache with network_info: [{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance network_info: |[{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] Acquired lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Refreshing network info cache for port 9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updated VIF entry in instance network info cache for port 9d101a1a-3dc1-493f-bbb9-649aabca0df7. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG nova.network.neutron [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating instance_info_cache with network_info: [{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73ac914a-4536-4dcf-8f68-62f8a0e39134 req-94859cff-21b9-4ad7-8183-8138b252689a service nova] Releasing lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:25:16 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088701.7897382, 2efecb76-18e1-46b5-81a1-c54fc6bb74c2 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:25:16 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] VM Stopped (Lifecycle Event)
Aug 26 22:25:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b760745d-4409-4405-9163-55fd7541739d None None] [instance: 2efecb76-18e1-46b5-81a1-c54fc6bb74c2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:25:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-changed-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Refreshing instance network info cache due to event network-changed-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] Acquiring lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] Acquired lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Refreshing network info cache for port cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updated VIF entry in instance network info cache for port cf6f6be2-e9c2-4e1f-8379-8bff3e253de3. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating instance_info_cache with network_info: [{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG nova.objects.instance [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'flavor' on Instance uuid 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b4c9025d-5ad3-43dd-ba3e-8b56fa65f5a8 req-f02c17e1-f260-4c0f-9074-ba5569cebf97 service nova] Releasing lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:25:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:21 user nova-compute[72929]: INFO nova.compute.manager [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Attaching volume d139b192-29d5-4415-a0b5-fc8a31837b16 to /dev/vdb
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.utils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a13b732-8f9a-46ef-9dc1-d21b9dad9cfd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca10e5a3-c015-4dda-ac7a-ce5f3075d352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d197ac6a-e0b5-4554-931c-d06429b797a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc54ba4a-f3cc-40f4-9c38-43ff8075c28f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:25:21 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97fa745-14e7-438e-9a87-dbaf854ac18d]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.utils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating existing volume attachment record: 8e7fc0d5-851d-4447-90ce-0d46d93c0c03 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG os_brick.utils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[679318d7-45f8-4ed7-8c75-c88894e34934]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:21 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a890d2-f968-4637-8d91-1fe41d0dad48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c0cc4e-4bec-4ffe-a35b-1e88cbc77709]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7363f7-6176-4840-bc58-cb3ec3d1491a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:25:22 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f19ac94-0fa2-461b-8ed7-6dffb6832c9c]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.utils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating existing volume attachment record: 6c0c4721-fbd9-41da-83ab-1f9c82054e6a {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-changed-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Refreshing instance network info cache due to event network-changed-32411ca9-563c-4bc0-a595-8c2e5abf4e88. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] Acquiring lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] Acquired lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Refreshing network info cache for port 32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.objects.instance [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'flavor' on Instance uuid b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Ignoring supplied device name: /dev/vdb
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:22 user nova-compute[72929]: INFO nova.compute.manager [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Attaching volume c1728857-4294-4452-9136-8fc001d1231e to /dev/vdb
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updated VIF entry in instance network info cache for port 32411ca9-563c-4bc0-a595-8c2e5abf4e88. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updating instance_info_cache with network_info: [{"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7b56525e-9867-47c6-8cd8-898ed6e9a19c req-069dc2c3-335e-42d5-942e-624dfa61c9fe service nova] Releasing lock "refresh_cache-b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.utils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f1e8d2-a128-402a-9ca4-2653e52d4737]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d8db1a-1b32-4d8a-947d-5b27a00795b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b858c1ef-da73-4999-938e-16330d19c50a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f0294-b768-4ae5-8c49-6e47fd1d5f56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:25:22 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:25:22 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bb439-5fe3-42ba-a093-e20d5db65fab]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG os_brick.utils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:22 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updating existing volume attachment record: 4dc97412-183c-4827-a701-4b3d8136d621 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:25:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcApYrvW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:32 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:32 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:32 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4b79c6-01cd-4214-8fa1-3d70a682375e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:25:32 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0224df93-b8bf-4d6c-b85a-5efae22161bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16] added
Aug 26 22:25:32 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc07dd-81b2-4302-b31f-e2cef05e646a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c48adce-e512-45e4-87df-16899af1cf48]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcApYrvW {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcApYrvW" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3d3202-c78f-4ead-9198-6f5655da3d88]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KcApYrvW'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3305738-1dcb-4a93-95e8-137b516b0fd1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:32 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f2e272-3a5a-478d-bfc5-0ccc089143c8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446f2a0-5ed8-44cb-9b12-ca76d09afb0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260]
Aug 26 22:25:33 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260] successful.
Aug 26 22:25:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb4d1e8-0d9b-49f4-8265-2a9179c1b279]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[29031098-8d9d-4809-93a0-95529dcdae04]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:33 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:33 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca90300-d5a6-4e45-907e-371392695e26]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcApYrvW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:25:33 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Creating image(s)
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Ensure instance console log exists: /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Start _get_guest_xml network_info=[{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '6c0c4721-fbd9-41da-83ab-1f9c82054e6a', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7993d49-af45-433e-8676-38ec3e12960f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffba64a1-49e9-4eb3-84a4-f56b6d40efa6', 'serial': 'ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:25:33 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:25:33 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:33 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:33 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23738323136366439', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738323136366439', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.382s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:34 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:34 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.objects.instance [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'flavor' on Instance uuid 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cda936-3df2-4863-9260-8efa69e5ac11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:25:34 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:25:34 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:25:34 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:25:34 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:25:34 user nova-compute[72929]:   <serial>d139b192-29d5-4415-a0b5-fc8a31837b16</serial>
Aug 26 22:25:34 user nova-compute[72929]: </disk>
Aug 26 22:25:34 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjFflzkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:34 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[17231468-f94c-4ad5-b7e7-5980ab969b72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6] added
Aug 26 22:25:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec9ddb-3dac-4002-9c6a-ed75fd3657bd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2cbc8b-a026-432b-859c-33fe2293e9f4]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjskGSbQ {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjskGSbQ" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92b8086-9ea8-4f02-b8d4-b35c1e35c372]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cjskGSbQ'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ecdb73-c1ff-495e-ba37-cdb2809723ae]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e5a036-bf31-4e22-b44b-ac45e1534579]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd82c0-efb7-4fc7-b6f1-1c2e1d32eb27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260]
Aug 26 22:25:34 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260] successful.
Aug 26 22:25:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[332bc1b0-7b46-49d8-afcf-87082a1cbfa6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[465e7d8b-7efd-4c25-977a-5502ca3ddf78]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:34 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:34 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] HCTL ('37', '-', '-', 0) found on session 53 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e48696-b07b-4e16-92de-1bd0d66deec0]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching for a device in session 53 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No VIF found with MAC fa:16:3e:3e:52:e3, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:25:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa30-ff79-4675-ae4d-3fe43cd07b5f tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.599s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== connect_volume: return (1727ms) {'type': 'block', 'scsi_wwn': '26664333731663437', 'path': '/dev/sdf'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664333731663437', 'path': '/dev/sdf'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.308s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:35 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:35 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-196411701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-196411701',id=47,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-k3f5mxv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:25:11Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=b7993d49-af45-433e-8676-38ec3e12960f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.objects.instance [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'pci_devices' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e470e6fd-c1ba-4da5-8c13-7462df7236e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:25:35 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:25:35 user nova-compute[72929]:   <uuid>b7993d49-af45-433e-8676-38ec3e12960f</uuid>
Aug 26 22:25:35 user nova-compute[72929]:   <name>instance-0000002f</name>
Aug 26 22:25:35 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:25:35 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:25:35 user nova-compute[72929]:   <metadata>
Aug 26 22:25:35 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:25:35 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:25:35 user nova-compute[72929]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-196411701</nova:name>
Aug 26 22:25:35 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:25:33</nova:creationTime>
Aug 26 22:25:35 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:25:35 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:25:35 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:25:35 user nova-compute[72929]:       <nova:owner>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:user uuid="cc2833663e85431fa3433a128520c8a8">tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member</nova:user>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:project uuid="dcc89a603c20492d9a2f41085f0e10f5">tempest-ServerBootFromVolumeStableRescueTest-650830425</nova:project>
Aug 26 22:25:35 user nova-compute[72929]:       </nova:owner>
Aug 26 22:25:35 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:25:35 user nova-compute[72929]:       <nova:ports>
Aug 26 22:25:35 user nova-compute[72929]:         <nova:port uuid="9d101a1a-3dc1-493f-bbb9-649aabca0df7">
Aug 26 22:25:35 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 22:25:35 user nova-compute[72929]:         </nova:port>
Aug 26 22:25:35 user nova-compute[72929]:       </nova:ports>
Aug 26 22:25:35 user nova-compute[72929]:     </nova:instance>
Aug 26 22:25:35 user nova-compute[72929]:   </metadata>
Aug 26 22:25:35 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:25:35 user nova-compute[72929]:     <system>
Aug 26 22:25:35 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:25:35 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:25:35 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:25:35 user nova-compute[72929]:       <entry name="serial">b7993d49-af45-433e-8676-38ec3e12960f</entry>
Aug 26 22:25:35 user nova-compute[72929]:       <entry name="uuid">b7993d49-af45-433e-8676-38ec3e12960f</entry>
Aug 26 22:25:35 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:25:35 user nova-compute[72929]:     </system>
Aug 26 22:25:35 user nova-compute[72929]:   </sysinfo>
Aug 26 22:25:35 user nova-compute[72929]:   <os>
Aug 26 22:25:35 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:25:35 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:25:35 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:25:35 user nova-compute[72929]:   </os>
Aug 26 22:25:35 user nova-compute[72929]:   <features>
Aug 26 22:25:35 user nova-compute[72929]:     <acpi/>
Aug 26 22:25:35 user nova-compute[72929]:     <apic/>
Aug 26 22:25:35 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:25:35 user nova-compute[72929]:   </features>
Aug 26 22:25:35 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:25:35 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:25:35 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:25:35 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:25:35 user nova-compute[72929]:   </clock>
Aug 26 22:25:35 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:25:35 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:25:35 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:25:35 user nova-compute[72929]:   </cpu>
Aug 26 22:25:35 user nova-compute[72929]:   <devices>
Aug 26 22:25:35 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:25:35 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:25:35 user nova-compute[72929]:       <source dev="/dev/sdf"/>
Aug 26 22:25:35 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:25:35 user nova-compute[72929]:       <serial>ffba64a1-49e9-4eb3-84a4-f56b6d40efa6</serial>
Aug 26 22:25:35 user nova-compute[72929]:     </disk>
Aug 26 22:25:35 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:25:35 user nova-compute[72929]:       <mac address="fa:16:3e:de:e9:9c"/>
Aug 26 22:25:35 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:25:35 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:25:35 user nova-compute[72929]:       <target dev="tap9d101a1a-3d"/>
Aug 26 22:25:35 user nova-compute[72929]:     </interface>
Aug 26 22:25:35 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:25:35 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/console.log" append="off"/>
Aug 26 22:25:35 user nova-compute[72929]:     </serial>
Aug 26 22:25:35 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:25:35 user nova-compute[72929]:     <video>
Aug 26 22:25:35 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:25:35 user nova-compute[72929]:     </video>
Aug 26 22:25:35 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:25:35 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:25:35 user nova-compute[72929]:     </rng>
Aug 26 22:25:35 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:25:35 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:25:35 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:25:35 user nova-compute[72929]:     </memballoon>
Aug 26 22:25:35 user nova-compute[72929]:   </devices>
Aug 26 22:25:35 user nova-compute[72929]: </domain>
Aug 26 22:25:35 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-196411701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-196411701',id=47,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-k3f5mxv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:25:11Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=b7993d49-af45-433e-8676-38ec3e12960f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_vif [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03bd810-9c05-4c1b-81c1-fac5beebdf50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d101a1a-3d, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9d101a1a-3d, col_values=(('external_ids', {'iface-id': '9d101a1a-3dc1-493f-bbb9-649aabca0df7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:e9:9c', 'vm-uuid': 'b7993d49-af45-433e-8676-38ec3e12960f'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e] added
Aug 26 22:25:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:35 user nova-compute[72929]: INFO os_vif [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d')
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e538ed-352b-42c1-9587-c1cd21d339c7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d39c41-ffb8-4581-9ca1-bc9c709f18ab]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjFflzkK {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TjFflzkK" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f780f7-04bb-4776-9155-e58966cfdfce]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TjFflzkK'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No VIF found with MAC fa:16:3e:de:e9:9c, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e456a-e918-4a8d-990c-70716d3d5b12]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a044e273-ef5f-4c03-8182-918855041c4d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb6b7f-53d3-431c-8ed0-a5ceba3c977e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260]
Aug 26 22:25:35 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260] successful.
Aug 26 22:25:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0308c1d-a1e4-444c-9f6e-6dd2ae9543e8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b06c550-618c-45af-8065-84c1b6cabed5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:25:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:35 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:25:35 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] HCTL ('38', '-', '-', 0) found on session 54 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53cdaa9-d37f-4240-9848-9cbc034c6a02]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Searching for a device in session 54 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:25:35 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjFflzkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:36 user nova-compute[72929]: INFO nova.compute.manager [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Detaching volume d139b192-29d5-4415-a0b5-fc8a31837b16
Aug 26 22:25:36 user nova-compute[72929]: INFO nova.virt.block_device [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Attempting to driver detach volume d139b192-29d5-4415-a0b5-fc8a31837b16 from mountpoint /dev/vdb
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Attempting to detach device vdb from instance 8dd90429-8672-4c4f-b719-bb54921646f2 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:25:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:25:36 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:25:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:25:36 user nova-compute[72929]:   <serial>d139b192-29d5-4415-a0b5-fc8a31837b16</serial>
Aug 26 22:25:36 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:25:36 user nova-compute[72929]: </disk>
Aug 26 22:25:36 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:25:36 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully detached device vdb from instance 8dd90429-8672-4c4f-b719-bb54921646f2 from the persistent domain config.
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8dd90429-8672-4c4f-b719-bb54921646f2 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:25:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:25:36 user nova-compute[72929]:   <source dev="/dev/sdb"/>
Aug 26 22:25:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:25:36 user nova-compute[72929]:   <serial>d139b192-29d5-4415-a0b5-fc8a31837b16</serial>
Aug 26 22:25:36 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:25:36 user nova-compute[72929]: </disk>
Aug 26 22:25:36 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== connect_volume: return (2698ms) {'type': 'block', 'scsi_wwn': '23666646164316239', 'path': '/dev/sdg'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666646164316239', 'path': '/dev/sdg'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.objects.instance [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'flavor' on Instance uuid b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:36 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:25:36 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:25:36 user nova-compute[72929]:   <source dev="/dev/sdg"/>
Aug 26 22:25:36 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:25:36 user nova-compute[72929]:   <serial>c1728857-4294-4452-9136-8fc001d1231e</serial>
Aug 26 22:25:36 user nova-compute[72929]: </disk>
Aug 26 22:25:36 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-b2ef5258-ff39-4bfa-b01b-a0983d987192 req-f03a3186-a55c-4d8b-a83b-20bf434b9d38 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b2ef5258-ff39-4bfa-b01b-a0983d987192 req-f03a3186-a55c-4d8b-a83b-20bf434b9d38 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b2ef5258-ff39-4bfa-b01b-a0983d987192 req-f03a3186-a55c-4d8b-a83b-20bf434b9d38 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b2ef5258-ff39-4bfa-b01b-a0983d987192 req-f03a3186-a55c-4d8b-a83b-20bf434b9d38 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-b2ef5258-ff39-4bfa-b01b-a0983d987192 req-f03a3186-a55c-4d8b-a83b-20bf434b9d38 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:25:37 user nova-compute[72929]: WARNING nova.compute.manager [req-b2ef5258-ff39-4bfa-b01b-a0983d987192 req-f03a3186-a55c-4d8b-a83b-20bf434b9d38 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state building and task_state spawning.
Aug 26 22:25:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088737.5347106, 8dd90429-8672-4c4f-b719-bb54921646f2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:25:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully detached device vdb from instance 8dd90429-8672-4c4f-b719-bb54921646f2 from the live domain config.
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcApYrvW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:37 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063cbe5-0bf0-4b83-87cd-419a4b2018b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[554ec3af-057b-4046-9283-1ed2cc55bac5]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:25:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:37 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:25:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0ba6896680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0449afc2-da66-4e29-b5fd-2c4829563cfd]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b63a9-00d3-49bb-9ba6-3183708f91ca]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d251ae-5f8c-46ad-89df-f6fdbf240cc3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3ee856-cc35-47fd-acfe-c2e6caa4f9e2]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8356cd75-0c93-491b-94c1-c054f0e270f3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[15927421-5db4-4315-b7ba-f00d1a96c1a3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260]
Aug 26 22:25:37 user nova-compute[72929]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16, portal: 172.16.0.220,3260] successful.
Aug 26 22:25:37 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d139b192-29d5-4415-a0b5-fc8a31837b16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b984c08b-aeaf-4a58-9544-49f2711cc671]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] <== disconnect_volume: return (279ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:25:37 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] No VIF found with MAC fa:16:3e:7b:69:b5, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-05e38fab-d841-4bec-af8d-aa27e7d9d7fe tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.489s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG nova.objects.instance [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'flavor' on Instance uuid 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-841607ce-64fc-4673-b2e1-7984c1b5e2c4 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.987s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updating instance_info_cache with network_info: [{"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-5be90001-c03f-466e-a8d1-bc167da12cc9" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [req-8cfea061-3b7d-4d42-a1b9-465fca7f34b7 req-7eadf1f2-b13e-418b-8a4e-688b409a8338 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8cfea061-3b7d-4d42-a1b9-465fca7f34b7 req-7eadf1f2-b13e-418b-8a4e-688b409a8338 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8cfea061-3b7d-4d42-a1b9-465fca7f34b7 req-7eadf1f2-b13e-418b-8a4e-688b409a8338 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8cfea061-3b7d-4d42-a1b9-465fca7f34b7 req-7eadf1f2-b13e-418b-8a4e-688b409a8338 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [req-8cfea061-3b7d-4d42-a1b9-465fca7f34b7 req-7eadf1f2-b13e-418b-8a4e-688b409a8338 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:25:39 user nova-compute[72929]: WARNING nova.compute.manager [req-8cfea061-3b7d-4d42-a1b9-465fca7f34b7 req-7eadf1f2-b13e-418b-8a4e-688b409a8338 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state building and task_state spawning.
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088739.652127, b7993d49-af45-433e-8676-38ec3e12960f => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Resumed (Lifecycle Event)
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance spawned successfully.
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088739.6570373, b7993d49-af45-433e-8676-38ec3e12960f => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Started (Lifecycle Event)
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:39 user nova-compute[72929]: INFO nova.compute.manager [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Took 29.18 seconds to build instance.
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-91113529-cc75-4dcd-b379-9c38bb34a0bb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "b7993d49-af45-433e-8676-38ec3e12960f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.274s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:42 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:25:42 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7937MB free_disk=23.857921600341797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5be90001-c03f-466e-a8d1-bc167da12cc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 6426d900-d9c6-464e-aac3-a22392b39f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b7993d49-af45-433e-8676-38ec3e12960f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:25:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:25:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:47 user nova-compute[72929]: INFO nova.compute.manager [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Terminating instance
Aug 26 22:25:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-ffc66bea-38c5-49a0-94a7-8da8231f2d5a req-ca1ef479-5c34-414b-8eaa-c139b28493cd service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-vif-unplugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ffc66bea-38c5-49a0-94a7-8da8231f2d5a req-ca1ef479-5c34-414b-8eaa-c139b28493cd service nova] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ffc66bea-38c5-49a0-94a7-8da8231f2d5a req-ca1ef479-5c34-414b-8eaa-c139b28493cd service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ffc66bea-38c5-49a0-94a7-8da8231f2d5a req-ca1ef479-5c34-414b-8eaa-c139b28493cd service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-ffc66bea-38c5-49a0-94a7-8da8231f2d5a req-ca1ef479-5c34-414b-8eaa-c139b28493cd service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] No waiting events found dispatching network-vif-unplugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:25:47 user nova-compute[72929]: DEBUG nova.compute.manager [req-ffc66bea-38c5-49a0-94a7-8da8231f2d5a req-ca1ef479-5c34-414b-8eaa-c139b28493cd service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-vif-unplugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:25:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Instance destroyed successfully.
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'resources' on Instance uuid 5be90001-c03f-466e-a8d1-bc167da12cc9 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:20:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1213688735',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1213688735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1213688735',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc+oJhe4j9t0KtFJp8X2Ba6UfPjWyJcj38VrtK8acNV1gdUWs02mDbm2dw1xUzT3elczHe5doUEii0XXGlxDeRnfleBZhE/0ChfINR/ZeFOYYn+xtIktfykiEwlaFkcrg==',key_name='tempest-keypair-1483115157',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-cllywavv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:21:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf31c30629f7485a9b160f8d853096dc',uuid=5be90001-c03f-466e-a8d1-bc167da12cc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "address": "fa:16:3e:a7:e0:84", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8db3359-f8", "ovs_interfaceid": "b8db3359-f80b-4d0e-9ac2-78a9cde67727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_vif [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8db3359-f8, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:25:48 user nova-compute[72929]: INFO os_vif [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:e0:84,bridge_name='br-int',has_traffic_filtering=True,id=b8db3359-f80b-4d0e-9ac2-78a9cde67727,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8db3359-f8')
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCoTXIlz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:25:48 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e4f8d0-47f2-4d7d-a721-ff1e434b38b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e529578-c389-4c23-96ef-ffe24caf3001]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:25:48 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:25:48 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:25:48 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8028b490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[99612f5f-dbbd-4f00-b8a7-47c9d875948d]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3349f-02b5-4a27-b5d3-e154d4b16e2d]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1977279-b8a1-412b-a82a-81bc98ed9102]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[150e259e-481e-415d-8480-7d52d4798d46]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe4d83408-f5a83e7af1ba1e5e', '/dev/disk/by-id/scsi-26635613833653761', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e4d83408') {{(pid=84150) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[34260a33-33cc-4361-96c7-ca1df01dd51b]: (4, None) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5233a55-0c5e-4f3e-a8c0-13c943621990]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e49691-b94b-4395-9a29-669c915d8084]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260]
Aug 26 22:25:48 user nova-compute[72929]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c, portal: 172.16.0.220,3260] successful.
Aug 26 22:25:48 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91f679b5-012a-4232-a36c-f401f632046c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[12055bb4-a914-4e82-bcb9-890085604266]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== disconnect_volume: return (310ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:25:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Deleting instance files /opt/stack/data/nova/instances/5be90001-c03f-466e-a8d1-bc167da12cc9_del
Aug 26 22:25:48 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Deletion of /opt/stack/data/nova/instances/5be90001-c03f-466e-a8d1-bc167da12cc9_del complete
Aug 26 22:25:48 user nova-compute[72929]: INFO nova.compute.manager [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 26 22:25:48 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:25:48 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:25:49 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:25:49 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Took 0.86 seconds to deallocate network for instance.
Aug 26 22:25:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] Acquiring lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] No waiting events found dispatching network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:25:49 user nova-compute[72929]: WARNING nova.compute.manager [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received unexpected event network-vif-plugged-b8db3359-f80b-4d0e-9ac2-78a9cde67727 for instance with vm_state active and task_state deleting.
Aug 26 22:25:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-f7dea2df-3c87-4ff5-9ce3-f2a9f7816622 req-bc4a4e0e-e45f-4448-a9c8-810387a84441 service nova] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Received event network-vif-deleted-b8db3359-f80b-4d0e-9ac2-78a9cde67727 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:25:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:25:50 user nova-compute[72929]: INFO nova.compute.manager [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Took 1.00 seconds to detach 1 volumes for instance.
Aug 26 22:25:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Deleting volume: 91f679b5-012a-4232-a36c-f401f632046c {{(pid=72929) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 26 22:25:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:25:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:25:50 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:25:50 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:25:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:50 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Deleted allocations for instance 5be90001-c03f-466e-a8d1-bc167da12cc9
Aug 26 22:25:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c1508858-1f64-4d09-8a8a-8be901288092 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "5be90001-c03f-466e-a8d1-bc167da12cc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.713s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:25:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:25:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:03 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088748.0848668, 5be90001-c03f-466e-a8d1-bc167da12cc9 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:26:03 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] VM Stopped (Lifecycle Event)
Aug 26 22:26:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4ca3ef78-835a-43a1-9838-465c5028304e None None] [instance: 5be90001-c03f-466e-a8d1-bc167da12cc9] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:26:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:16 user nova-compute[72929]: INFO nova.compute.manager [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Detaching volume c1728857-4294-4452-9136-8fc001d1231e
Aug 26 22:26:16 user nova-compute[72929]: INFO nova.virt.block_device [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Attempting to driver detach volume c1728857-4294-4452-9136-8fc001d1231e from mountpoint /dev/vdb
Aug 26 22:26:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Attempting to detach device vdb from instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:26:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:26:16 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:26:16 user nova-compute[72929]:   <source dev="/dev/sdg"/>
Aug 26 22:26:16 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:26:16 user nova-compute[72929]:   <serial>c1728857-4294-4452-9136-8fc001d1231e</serial>
Aug 26 22:26:16 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:26:16 user nova-compute[72929]: </disk>
Aug 26 22:26:16 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:26:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully detached device vdb from instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 from the persistent domain config.
Aug 26 22:26:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:26:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:26:16 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:26:16 user nova-compute[72929]:   <source dev="/dev/sdg"/>
Aug 26 22:26:16 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:26:16 user nova-compute[72929]:   <serial>c1728857-4294-4452-9136-8fc001d1231e</serial>
Aug 26 22:26:16 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:26:16 user nova-compute[72929]: </disk>
Aug 26 22:26:16 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:26:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088777.1274035, b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:26:17 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully detached device vdb from instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 from the live domain config.
Aug 26 22:26:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjFflzkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:26:17 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46787706-12f6-45cc-a6ff-6dc78a22ce6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f75586-09a5-4205-9789-a2cfda6e3618]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:26:17 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:26:17 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:26:17 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:26:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:26:17 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:26:17 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:26:17 user nova-compute[72929]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e (non-flash)
Aug 26 22:26:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b98129c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e'): ({'sdg'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Removing single pathed devices sdg {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f670d09-7ded-4a81-8f7a-fdd0197dc02e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe031bb-5705-455f-bdf4-c2877d4a57cb]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Flushing IO for device /dev/sdg {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8129fbcf-a544-4d00-b288-3ba5f4a8e7f2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb9091c-6d64-4df5-965e-d2dde9a6816e]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] SCSI volumes sdg have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84fc84e-1271-4e0e-af51-8e3bc39314d7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[020bb145-22ea-4062-93b1-e8d49449b2fb]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260]
Aug 26 22:26:17 user nova-compute[72929]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e, portal: 172.16.0.220,3260] successful.
Aug 26 22:26:17 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f8004-96f0-4618-abd1-96a2e5706765]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== disconnect_volume: return (300ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:26:17 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG nova.objects.instance [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'flavor' on Instance uuid b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-e59ceb01-3a67-4d52-bd1d-40228aa45206 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.588s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:18 user nova-compute[72929]: INFO nova.compute.manager [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Terminating instance
Aug 26 22:26:18 user nova-compute[72929]: DEBUG nova.compute.manager [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-b42a45a4-94d7-4949-8112-b559334ec5db req-a087a73f-f351-49c4-b659-9397f0329f35 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-vif-unplugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b42a45a4-94d7-4949-8112-b559334ec5db req-a087a73f-f351-49c4-b659-9397f0329f35 service nova] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b42a45a4-94d7-4949-8112-b559334ec5db req-a087a73f-f351-49c4-b659-9397f0329f35 service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-b42a45a4-94d7-4949-8112-b559334ec5db req-a087a73f-f351-49c4-b659-9397f0329f35 service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-b42a45a4-94d7-4949-8112-b559334ec5db req-a087a73f-f351-49c4-b659-9397f0329f35 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] No waiting events found dispatching network-vif-unplugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:26:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-b42a45a4-94d7-4949-8112-b559334ec5db req-a087a73f-f351-49c4-b659-9397f0329f35 service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-vif-unplugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:26:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Instance destroyed successfully.
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lazy-loading 'resources' on Instance uuid b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1517963679',display_name='tempest-VolumesSnapshotTestJSON-instance-1517963679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1517963679',id=46,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyr07IovVszNqwKOMFFN/dKalpwJI8Q4xu1X7pPjtgKAai8xf6aHp+Jbp3BDkdObRZ/vzE0xU1vA4Ex220IDQREOQwipRF3ovDNSgdoUq6fC9pGSoqUG9PQ1t0r90XZLw==',key_name='tempest-keypair-129539297',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:23:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c59076b100394311b871aff3d8232639',ramdisk_id='',reservation_id='r-evctfvur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1269723',owner_user_name='tempest-VolumesSnapshotTestJSON-1269723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:23:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='270ea6e7f5ac4e64874f9d7aaf211b33',uuid=b70179ce-ad2d-419b-9e34-b9bb73ec5ea1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converting VIF {"id": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "address": "fa:16:3e:7b:69:b5", "network": {"id": "fe2e2e26-2313-4311-8947-3967b101fb23", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-565211901-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c59076b100394311b871aff3d8232639", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32411ca9-56", "ovs_interfaceid": "32411ca9-563c-4bc0-a595-8c2e5abf4e88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_vif [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32411ca9-56, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:19 user nova-compute[72929]: INFO os_vif [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:69:b5,bridge_name='br-int',has_traffic_filtering=True,id=32411ca9-563c-4bc0-a595-8c2e5abf4e88,network=Network(fe2e2e26-2313-4311-8947-3967b101fb23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32411ca9-56')
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TjFflzkK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:26:19 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1728857-4294-4452-9136-8fc001d1231e', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a75a230-23fd-422e-a046-eff5fd770d07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc660f8f-0830-4dcf-a44f-9f69a9136980]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:26:19 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:26:19 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:26:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:26:19 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:26:19 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:26:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8024bf40>, {}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Disconnecting from: [] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] <== disconnect_volume: return (55ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:26:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Deleting instance files /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1_del
Aug 26 22:26:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Deletion of /opt/stack/data/nova/instances/b70179ce-ad2d-419b-9e34-b9bb73ec5ea1_del complete
Aug 26 22:26:19 user nova-compute[72929]: INFO nova.compute.manager [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 26 22:26:19 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:26:19 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-2f497beb-650f-4f9d-8c9c-94e27ad6ee42 req-a50b9c53-75dc-4913-b441-76c86d32c93b service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-vif-deleted-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:20 user nova-compute[72929]: INFO nova.compute.manager [req-2f497beb-650f-4f9d-8c9c-94e27ad6ee42 req-a50b9c53-75dc-4913-b441-76c86d32c93b service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Neutron deleted interface 32411ca9-563c-4bc0-a595-8c2e5abf4e88; detaching it from the instance and deleting it from the info cache
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.network.neutron [req-2f497beb-650f-4f9d-8c9c-94e27ad6ee42 req-a50b9c53-75dc-4913-b441-76c86d32c93b service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:20 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Took 1.13 seconds to deallocate network for instance.
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-2f497beb-650f-4f9d-8c9c-94e27ad6ee42 req-a50b9c53-75dc-4913-b441-76c86d32c93b service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Detach interface failed, port_id=32411ca9-563c-4bc0-a595-8c2e5abf4e88, reason: Instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:26:20 user nova-compute[72929]: WARNING nova.volume.cinder [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Attachment 4dc97412-183c-4827-a701-4b3d8136d621 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4dc97412-183c-4827-a701-4b3d8136d621. (HTTP 404) (Request-ID: req-275565eb-cb79-41be-a22a-013eeaec3712)
Aug 26 22:26:20 user nova-compute[72929]: INFO nova.compute.manager [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Took 0.02 seconds to detach 1 volumes for instance.
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-cb6246e6-df11-4206-b519-b6c5c613ab6f req-c068efc0-1955-4db0-bc4f-01076d0d62aa service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received event network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cb6246e6-df11-4206-b519-b6c5c613ab6f req-c068efc0-1955-4db0-bc4f-01076d0d62aa service nova] Acquiring lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cb6246e6-df11-4206-b519-b6c5c613ab6f req-c068efc0-1955-4db0-bc4f-01076d0d62aa service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cb6246e6-df11-4206-b519-b6c5c613ab6f req-c068efc0-1955-4db0-bc4f-01076d0d62aa service nova] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.compute.manager [req-cb6246e6-df11-4206-b519-b6c5c613ab6f req-c068efc0-1955-4db0-bc4f-01076d0d62aa service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] No waiting events found dispatching network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:26:20 user nova-compute[72929]: WARNING nova.compute.manager [req-cb6246e6-df11-4206-b519-b6c5c613ab6f req-c068efc0-1955-4db0-bc4f-01076d0d62aa service nova] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Received unexpected event network-vif-plugged-32411ca9-563c-4bc0-a595-8c2e5abf4e88 for instance with vm_state deleted and task_state None.
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:20 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Deleted allocations for instance b70179ce-ad2d-419b-9e34-b9bb73ec5ea1
Aug 26 22:26:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6924893d-cc84-4ba6-9627-82afcc4155e9 tempest-VolumesSnapshotTestJSON-1269723 tempest-VolumesSnapshotTestJSON-1269723-project-member] Lock "b70179ce-ad2d-419b-9e34-b9bb73ec5ea1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.602s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing instance network info cache due to event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updated VIF entry in instance network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-5d9bf716-0282-4a5e-a42a-6e0ca59c0216 req-eafc2d0e-9e2c-4800-85e6-e1be40861a28 service nova] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:23 user nova-compute[72929]: INFO nova.compute.manager [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Detaching volume fbd29d77-87ec-4f06-9834-962effaf8daf
Aug 26 22:26:23 user nova-compute[72929]: INFO nova.virt.block_device [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Attempting to driver detach volume fbd29d77-87ec-4f06-9834-962effaf8daf from mountpoint /dev/vdb
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Attempting to detach device vdb from instance 6426d900-d9c6-464e-aac3-a22392b39f9c from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:26:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:26:23 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:26:23 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:26:23 user nova-compute[72929]:   <serial>fbd29d77-87ec-4f06-9834-962effaf8daf</serial>
Aug 26 22:26:23 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:26:23 user nova-compute[72929]: </disk>
Aug 26 22:26:23 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:26:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully detached device vdb from instance 6426d900-d9c6-464e-aac3-a22392b39f9c from the persistent domain config.
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6426d900-d9c6-464e-aac3-a22392b39f9c from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:26:23 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:26:23 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:26:23 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:26:23 user nova-compute[72929]:   <serial>fbd29d77-87ec-4f06-9834-962effaf8daf</serial>
Aug 26 22:26:23 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:26:23 user nova-compute[72929]: </disk>
Aug 26 22:26:23 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088783.6071193, 6426d900-d9c6-464e-aac3-a22392b39f9c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:26:23 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully detached device vdb from instance 6426d900-d9c6-464e-aac3-a22392b39f9c from the live domain config.
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sWpnqfHR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:26:23 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4440555a-2a58-4a4e-b3f0-3cea9c7627be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6c279-8843-4b82-a766-8fc94743fcb2]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:26:23 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:26:23 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:26:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:26:23 user nova-compute[72929]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf (non-flash)
Aug 26 22:26:23 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:26:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b801a0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[97541421-8e03-4332-be84-cac9909c095c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f30dac-4bc6-414a-8427-5020ba85c08c]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f75ce-42f3-4a61-ac17-e5f9e07f5084]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[747da778-bf4e-46bb-8f28-281e4d29ad9f]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56c462-1f8f-4e11-9c56-1c36adab71f1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bc36a2-9897-4296-9d3e-7d020ff26e51]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260]
Aug 26 22:26:23 user nova-compute[72929]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf, portal: 172.16.0.220,3260] successful.
Aug 26 22:26:23 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fbd29d77-87ec-4f06-9834-962effaf8daf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28cc912-2dcf-44aa-a51c-0139e5ff0326]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] <== disconnect_volume: return (274ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:26:23 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG nova.compute.manager [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing instance network info cache due to event network-changed-fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] Acquiring lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] Acquired lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Refreshing network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updated VIF entry in instance network info cache for port fb64b410-f883-4c5b-ba7d-b8374d1ff579. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG nova.network.neutron [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [{"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36efd149-a6fa-4397-a7a5-996277628ad8 req-b6ed1c58-3fb1-4c3f-ac25-7d668002e01e service nova] Releasing lock "refresh_cache-6426d900-d9c6-464e-aac3-a22392b39f9c" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG nova.objects.instance [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'flavor' on Instance uuid 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:26:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-c2316433-ff62-4826-91fb-e5a06008bf59 tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.827s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:34 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088779.1653864, b70179ce-ad2d-419b-9e34-b9bb73ec5ea1 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:26:34 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] VM Stopped (Lifecycle Event)
Aug 26 22:26:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-676a30db-44d6-45fa-a9a5-101a4684a361 None None] [instance: b70179ce-ad2d-419b-9e34-b9bb73ec5ea1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:26:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:26:37 user nova-compute[72929]: INFO nova.compute.manager [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] instance snapshotting
Aug 26 22:26:37 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Beginning live snapshot process
Aug 26 22:26:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:37 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json -f qcow2 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpedfalije/65bdc67af58941828852c7f93d9fb716.delta 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpedfalije/65bdc67af58941828852c7f93d9fb716.delta 1073741824" returned: 0 in 0.052s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:38 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:38 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updating instance_info_cache with network_info: [{"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72929) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 26 22:26:39 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 26 22:26:39 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:26:39 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpedfalije/65bdc67af58941828852c7f93d9fb716.delta /opt/stack/data/nova/instances/snapshots/tmpedfalije/65bdc67af58941828852c7f93d9fb716 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:26:40 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpedfalije/65bdc67af58941828852c7f93d9fb716.delta /opt/stack/data/nova/instances/snapshots/tmpedfalije/65bdc67af58941828852c7f93d9fb716" returned: 0 in 0.814s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:40 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Snapshot extracted, beginning image upload
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:26:41 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Snapshot image upload complete
Aug 26 22:26:43 user nova-compute[72929]: INFO nova.compute.manager [None req-61898bec-f14a-46cf-9944-3364580b9928 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Took 5.59 seconds to snapshot the instance on the hypervisor.
Aug 26 22:26:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:43 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:26:43 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8142MB free_disk=23.825519561767578GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 6426d900-d9c6-464e-aac3-a22392b39f9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b7993d49-af45-433e-8676-38ec3e12960f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:26:43 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:26:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:26:45 user nova-compute[72929]: INFO nova.compute.claims [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Claim successful on node user
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:26:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:26:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG nova.policy [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c1250b5ba63437bb762df331fd6a80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '302aa381f3904125a45c479568f7533c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:26:46 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Creating image(s)
Aug 26 22:26:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "/opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "/opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "/opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Successfully created port: 286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.part --force-share --output=json" returned: 0 in 0.200s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG nova.virt.images [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] d1309c4c-0497-402d-889f-1bfd414eab69 was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.part /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.part /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.converted" returned: 0 in 0.646s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Successfully updated port: 286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquired lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-changed-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Refreshing instance network info cache due to event network-changed-286b78ad-c592-4a4c-91ff-291a7a1c1bf8. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] Acquiring lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.103s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.network.neutron [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating instance_info_cache with network_info: [{"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Releasing lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Instance network_info: |[{"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] Acquired lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Refreshing network info cache for port 286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d,backing_fmt=raw /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d,backing_fmt=raw /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk 1073741824" returned: 0 in 0.121s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d --force-share --output=json" returned: 0 in 0.233s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Ensure instance console log exists: /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Start _get_guest_xml network_info=[{"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='faf0533058a7edc98ff896a6206a1a8a',container_format='bare',created_at=2023-08-26T22:26:37Z,direct_url=<?>,disk_format='qcow2',id=d1309c4c-0497-402d-889f-1bfd414eab69,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-248931108',owner='302aa381f3904125a45c479568f7533c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T22:26:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': 'd1309c4c-0497-402d-889f-1bfd414eab69'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:26:48 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:26:48 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:26:48 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='faf0533058a7edc98ff896a6206a1a8a',container_format='bare',created_at=2023-08-26T22:26:37Z,direct_url=<?>,disk_format='qcow2',id=d1309c4c-0497-402d-889f-1bfd414eab69,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-248931108',owner='302aa381f3904125a45c479568f7533c',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-26T22:26:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1351490129',display_name='tempest-TestStampPattern-server-1351490129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1351490129',id=48,image_ref='d1309c4c-0497-402d-889f-1bfd414eab69',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiaLbB2o5ogep87t7WRN4urPuEDh9KfODTmawEmQ/qu+koXzGTao7gJ3UDoNxVJWqJmt66x5jrC7LMSYWaF8J15hYRkFpmbiahmJyfRf5/bnTHh7hhMlqJUwHVXMCZF6g==',key_name='tempest-TestStampPattern-1421469942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302aa381f3904125a45c479568f7533c',ramdisk_id='',reservation_id='r-17ibkpdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8dd90429-8672-4c4f-b719-bb54921646f2',image_min_disk='1',image_min_ram='0',image_owner_id='302aa381f3904125a45c479568f7533c',image_owner_project_name='tempest-TestStampPattern-396757775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-396757775-project-member',image_user_id='3c1250b5ba63437bb762df331fd6a80a',network_allocated='True',owner_project_name='tempest-TestStampPattern-396757775',owner_user_name='tempest-TestStampPattern-396757775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:26:46Z,user_data=None,user_id='3c1250b5ba63437bb762df331fd6a80a',uuid=5aee272f-0f8e-4933-bb08-0ec213add04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converting VIF {"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'pci_devices' on Instance uuid 5aee272f-0f8e-4933-bb08-0ec213add04b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:26:49 user nova-compute[72929]:   <uuid>5aee272f-0f8e-4933-bb08-0ec213add04b</uuid>
Aug 26 22:26:49 user nova-compute[72929]:   <name>instance-00000030</name>
Aug 26 22:26:49 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:26:49 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:26:49 user nova-compute[72929]:   <metadata>
Aug 26 22:26:49 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:26:49 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:26:49 user nova-compute[72929]:       <nova:name>tempest-TestStampPattern-server-1351490129</nova:name>
Aug 26 22:26:49 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:26:48</nova:creationTime>
Aug 26 22:26:49 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:26:49 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:26:49 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:26:49 user nova-compute[72929]:       <nova:owner>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:user uuid="3c1250b5ba63437bb762df331fd6a80a">tempest-TestStampPattern-396757775-project-member</nova:user>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:project uuid="302aa381f3904125a45c479568f7533c">tempest-TestStampPattern-396757775</nova:project>
Aug 26 22:26:49 user nova-compute[72929]:       </nova:owner>
Aug 26 22:26:49 user nova-compute[72929]:       <nova:root type="image" uuid="d1309c4c-0497-402d-889f-1bfd414eab69"/>
Aug 26 22:26:49 user nova-compute[72929]:       <nova:ports>
Aug 26 22:26:49 user nova-compute[72929]:         <nova:port uuid="286b78ad-c592-4a4c-91ff-291a7a1c1bf8">
Aug 26 22:26:49 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 22:26:49 user nova-compute[72929]:         </nova:port>
Aug 26 22:26:49 user nova-compute[72929]:       </nova:ports>
Aug 26 22:26:49 user nova-compute[72929]:     </nova:instance>
Aug 26 22:26:49 user nova-compute[72929]:   </metadata>
Aug 26 22:26:49 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:26:49 user nova-compute[72929]:     <system>
Aug 26 22:26:49 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:26:49 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:26:49 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:26:49 user nova-compute[72929]:       <entry name="serial">5aee272f-0f8e-4933-bb08-0ec213add04b</entry>
Aug 26 22:26:49 user nova-compute[72929]:       <entry name="uuid">5aee272f-0f8e-4933-bb08-0ec213add04b</entry>
Aug 26 22:26:49 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:26:49 user nova-compute[72929]:     </system>
Aug 26 22:26:49 user nova-compute[72929]:   </sysinfo>
Aug 26 22:26:49 user nova-compute[72929]:   <os>
Aug 26 22:26:49 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:26:49 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:26:49 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:26:49 user nova-compute[72929]:   </os>
Aug 26 22:26:49 user nova-compute[72929]:   <features>
Aug 26 22:26:49 user nova-compute[72929]:     <acpi/>
Aug 26 22:26:49 user nova-compute[72929]:     <apic/>
Aug 26 22:26:49 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:26:49 user nova-compute[72929]:   </features>
Aug 26 22:26:49 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:26:49 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:26:49 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:26:49 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:26:49 user nova-compute[72929]:   </clock>
Aug 26 22:26:49 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:26:49 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:26:49 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:26:49 user nova-compute[72929]:   </cpu>
Aug 26 22:26:49 user nova-compute[72929]:   <devices>
Aug 26 22:26:49 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:26:49 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:26:49 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk"/>
Aug 26 22:26:49 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:26:49 user nova-compute[72929]:     </disk>
Aug 26 22:26:49 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:26:49 user nova-compute[72929]:       <mac address="fa:16:3e:c5:f6:bc"/>
Aug 26 22:26:49 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:26:49 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:26:49 user nova-compute[72929]:       <target dev="tap286b78ad-c5"/>
Aug 26 22:26:49 user nova-compute[72929]:     </interface>
Aug 26 22:26:49 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:26:49 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/console.log" append="off"/>
Aug 26 22:26:49 user nova-compute[72929]:     </serial>
Aug 26 22:26:49 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:26:49 user nova-compute[72929]:     <video>
Aug 26 22:26:49 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:26:49 user nova-compute[72929]:     </video>
Aug 26 22:26:49 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:26:49 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:26:49 user nova-compute[72929]:     </rng>
Aug 26 22:26:49 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:26:49 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:26:49 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:26:49 user nova-compute[72929]:     </memballoon>
Aug 26 22:26:49 user nova-compute[72929]:   </devices>
Aug 26 22:26:49 user nova-compute[72929]: </domain>
Aug 26 22:26:49 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1351490129',display_name='tempest-TestStampPattern-server-1351490129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1351490129',id=48,image_ref='d1309c4c-0497-402d-889f-1bfd414eab69',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiaLbB2o5ogep87t7WRN4urPuEDh9KfODTmawEmQ/qu+koXzGTao7gJ3UDoNxVJWqJmt66x5jrC7LMSYWaF8J15hYRkFpmbiahmJyfRf5/bnTHh7hhMlqJUwHVXMCZF6g==',key_name='tempest-TestStampPattern-1421469942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='302aa381f3904125a45c479568f7533c',ramdisk_id='',reservation_id='r-17ibkpdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8dd90429-8672-4c4f-b719-bb54921646f2',image_min_disk='1',image_min_ram='0',image_owner_id='302aa381f3904125a45c479568f7533c',image_owner_project_name='tempest-TestStampPattern-396757775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-396757775-project-member',image_user_id='3c1250b5ba63437bb762df331fd6a80a',network_allocated='True',owner_project_name='tempest-TestStampPattern-396757775',owner_user_name='tempest-TestStampPattern-396757775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:26:46Z,user_data=None,user_id='3c1250b5ba63437bb762df331fd6a80a',uuid=5aee272f-0f8e-4933-bb08-0ec213add04b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converting VIF {"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG os_vif [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updated VIF entry in instance network info cache for port 286b78ad-c592-4a4c-91ff-291a7a1c1bf8. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating instance_info_cache with network_info: [{"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap286b78ad-c5, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap286b78ad-c5, col_values=(('external_ids', {'iface-id': '286b78ad-c592-4a4c-91ff-291a7a1c1bf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f6:bc', 'vm-uuid': '5aee272f-0f8e-4933-bb08-0ec213add04b'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0590a1e0-dc0e-4ede-b81e-858a36038ec8 req-44f5f3ef-79ab-4ca5-9540-1a642c2d7c02 service nova] Releasing lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:49 user nova-compute[72929]: INFO os_vif [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5')
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:26:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No VIF found with MAC fa:16:3e:c5:f6:bc, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-1e0753cd-1b1a-40b9-b63b-d1bff7ed76fd req-998b7bf3-162e-4acf-96a4-a5d2312975a9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1e0753cd-1b1a-40b9-b63b-d1bff7ed76fd req-998b7bf3-162e-4acf-96a4-a5d2312975a9 service nova] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1e0753cd-1b1a-40b9-b63b-d1bff7ed76fd req-998b7bf3-162e-4acf-96a4-a5d2312975a9 service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-1e0753cd-1b1a-40b9-b63b-d1bff7ed76fd req-998b7bf3-162e-4acf-96a4-a5d2312975a9 service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:50 user nova-compute[72929]: DEBUG nova.compute.manager [req-1e0753cd-1b1a-40b9-b63b-d1bff7ed76fd req-998b7bf3-162e-4acf-96a4-a5d2312975a9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] No waiting events found dispatching network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:26:50 user nova-compute[72929]: WARNING nova.compute.manager [req-1e0753cd-1b1a-40b9-b63b-d1bff7ed76fd req-998b7bf3-162e-4acf-96a4-a5d2312975a9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received unexpected event network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 for instance with vm_state building and task_state spawning.
Aug 26 22:26:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-092f6acf-c732-4248-8ad3-e16211047ce8 req-10fa50a2-d413-4eed-b3bb-ff933dca60ad service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-092f6acf-c732-4248-8ad3-e16211047ce8 req-10fa50a2-d413-4eed-b3bb-ff933dca60ad service nova] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-092f6acf-c732-4248-8ad3-e16211047ce8 req-10fa50a2-d413-4eed-b3bb-ff933dca60ad service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-092f6acf-c732-4248-8ad3-e16211047ce8 req-10fa50a2-d413-4eed-b3bb-ff933dca60ad service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-092f6acf-c732-4248-8ad3-e16211047ce8 req-10fa50a2-d413-4eed-b3bb-ff933dca60ad service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] No waiting events found dispatching network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:26:52 user nova-compute[72929]: WARNING nova.compute.manager [req-092f6acf-c732-4248-8ad3-e16211047ce8 req-10fa50a2-d413-4eed-b3bb-ff933dca60ad service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received unexpected event network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 for instance with vm_state building and task_state spawning.
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088813.1852522, 5aee272f-0f8e-4933-bb08-0ec213add04b => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] VM Resumed (Lifecycle Event)
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Instance spawned successfully.
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088813.1899266, 5aee272f-0f8e-4933-bb08-0ec213add04b => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] VM Started (Lifecycle Event)
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Took 7.19 seconds to spawn the instance on the hypervisor.
Aug 26 22:26:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:26:53 user nova-compute[72929]: INFO nova.compute.manager [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Took 8.10 seconds to build instance.
Aug 26 22:26:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b742cc12-9484-462f-b8ac-c885b1c5b69b tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.214s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:26:57 user nova-compute[72929]: INFO nova.compute.claims [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Claim successful on node user
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:26:57 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:26:57 user nova-compute[72929]: INFO nova.virt.block_device [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Booting with volume f845783e-a528-4e8a-8c71-854c428ef493 at /dev/vda
Aug 26 22:26:57 user nova-compute[72929]: DEBUG nova.policy [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf31c30629f7485a9b160f8d853096dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6b106b16484bfa8fd629b57527130f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG os_brick.utils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f49fe2-a612-41dd-8b7d-dfcad8f6230f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac826f0e-56ff-421b-870b-1c2e9db7e51f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:57 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9ea99c-e60a-4ab1-bfd3-3f8d1fe32f05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4d94b8-8f9c-42ee-970b-6ea39280e5e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:26:58 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:26:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6bb2df-bb89-4ef7-8129-0dfd3bd14012]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG os_brick.utils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updating existing volume attachment record: bd308a1a-efb8-42fd-8fad-bc47dc32a9b9 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:26:58 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Successfully created port: 31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Successfully updated port: 31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquired lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-changed-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Refreshing instance network info cache due to event network-changed-31b3f937-0174-48c1-b51f-09f1972e3746. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] Acquiring lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.network.neutron [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updating instance_info_cache with network_info: [{"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Releasing lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Instance network_info: |[{"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] Acquired lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:26:59 user nova-compute[72929]: DEBUG nova.network.neutron [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Refreshing network info cache for port 31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:27:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updated VIF entry in instance network info cache for port 31b3f937-0174-48c1-b51f-09f1972e3746. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:27:00 user nova-compute[72929]: DEBUG nova.network.neutron [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updating instance_info_cache with network_info: [{"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:27:00 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7cd786f9-4ea3-44f3-9c65-7cc37a14e018 req-c5c66f0b-a68d-4d8c-bbb8-224c901e9ff1 service nova] Releasing lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:27:01 user nova-compute[72929]: INFO nova.compute.manager [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Rescuing
Aug 26 22:27:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:27:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:27:01 user nova-compute[72929]: DEBUG nova.network.neutron [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG nova.network.neutron [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating instance_info_cache with network_info: [{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-d7cf7e38-904d-469b-9bf0-d467f7e4f700 req-3329c0c6-0624-4b89-8772-cf4ec2a39b69 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d7cf7e38-904d-469b-9bf0-d467f7e4f700 req-3329c0c6-0624-4b89-8772-cf4ec2a39b69 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d7cf7e38-904d-469b-9bf0-d467f7e4f700 req-3329c0c6-0624-4b89-8772-cf4ec2a39b69 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d7cf7e38-904d-469b-9bf0-d467f7e4f700 req-3329c0c6-0624-4b89-8772-cf4ec2a39b69 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG nova.compute.manager [req-d7cf7e38-904d-469b-9bf0-d467f7e4f700 req-3329c0c6-0624-4b89-8772-cf4ec2a39b69 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:02 user nova-compute[72929]: WARNING nova.compute.manager [req-d7cf7e38-904d-469b-9bf0-d467f7e4f700 req-3329c0c6-0624-4b89-8772-cf4ec2a39b69 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state rescuing.
Aug 26 22:27:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance destroyed successfully.
Aug 26 22:27:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Attempting a stable device rescue
Aug 26 22:27:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72929) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance directory exists: not creating {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 26 22:27:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Creating image(s)
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "/opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "f73e55f59076beefe2686581ba387b035fb82b5f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f73e55f59076beefe2686581ba387b035fb82b5f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:03 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.part --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.part --force-share --output=json" returned: 0 in 0.240s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG nova.virt.images [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] 85af8c1a-a664-4bed-a845-15931f2b4d2c was qcow2, converting to raw {{(pid=72929) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG nova.privsep.utils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72929) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.part /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.converted {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-0c112c4d-9017-4fd3-b551-51555b8733e0 req-d671eba8-b3e0-4712-9fb8-65617a6d667c service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0c112c4d-9017-4fd3-b551-51555b8733e0 req-d671eba8-b3e0-4712-9fb8-65617a6d667c service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0c112c4d-9017-4fd3-b551-51555b8733e0 req-d671eba8-b3e0-4712-9fb8-65617a6d667c service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0c112c4d-9017-4fd3-b551-51555b8733e0 req-d671eba8-b3e0-4712-9fb8-65617a6d667c service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG nova.compute.manager [req-0c112c4d-9017-4fd3-b551-51555b8733e0 req-d671eba8-b3e0-4712-9fb8-65617a6d667c service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:04 user nova-compute[72929]: WARNING nova.compute.manager [req-0c112c4d-9017-4fd3-b551-51555b8733e0 req-d671eba8-b3e0-4712-9fb8-65617a6d667c service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state rescuing.
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.part /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.converted" returned: 0 in 0.502s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:04 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.converted --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f73e55f59076beefe2686581ba387b035fb82b5f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.033s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "f73e55f59076beefe2686581ba387b035fb82b5f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f73e55f59076beefe2686581ba387b035fb82b5f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f,backing_fmt=raw /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f,backing_fmt=raw /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue" returned: 0 in 0.061s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f73e55f59076beefe2686581ba387b035fb82b5f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'migration_context' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<b7993d49-af45-433e-8676-38ec3e12960f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Start _get_guest_xml network_info=[{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "vif_mac": "fa:16:3e:de:e9:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '85af8c1a-a664-4bed-a845-15931f2b4d2c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '6c0c4721-fbd9-41da-83ab-1f9c82054e6a', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'b7993d49-af45-433e-8676-38ec3e12960f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffba64a1-49e9-4eb3-84a4-f56b6d40efa6', 'serial': 'ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'resources' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<b7993d49-af45-433e-8676-38ec3e12960f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'numa_topology' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<b7993d49-af45-433e-8676-38ec3e12960f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:27:05 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:27:05 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<b7993d49-af45-433e-8676-38ec3e12960f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:27:05 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:27:05 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:27:05 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad28f75-e686-4f22-9309-324aaf4574a3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cjskGSbQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 26 22:27:05 user nova-compute[72929]: node.name = iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6
Aug 26 22:27:05 user nova-compute[72929]: node.tpgt = -1
Aug 26 22:27:05 user nova-compute[72929]: node.startup = automatic
Aug 26 22:27:05 user nova-compute[72929]: node.leading_login = No
Aug 26 22:27:05 user nova-compute[72929]: iface.iscsi_ifacename = default
Aug 26 22:27:05 user nova-compute[72929]: iface.net_ifacename = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.ipaddress = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.prefix_len = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.hwaddress = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.transport_name = tcp
Aug 26 22:27:05 user nova-compute[72929]: iface.initiatorname = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.vlan_id = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.vlan_priority = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.vlan_state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.iface_num = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.mtu = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.port = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.bootproto = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.subnet_mask = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.gateway = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_alt_client_id_state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_alt_client_id = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_dns = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_learn_iqn = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_req_vendor_id_state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_vendor_id_state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_vendor_id = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.dhcp_slp_da = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.fragmentation = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.gratuitous_arp = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.incoming_forwarding = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.tos_state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.tos = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.ttl = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.delayed_ack = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.tcp_nagle = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.tcp_wsf_state = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.tcp_wsf = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.tcp_timer_scale = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.tcp_timestamp = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.redirect = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.def_task_mgmt_timeout = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.header_digest = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.data_digest = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.immediate_data = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.initial_r2t = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.data_seq_inorder = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.data_pdu_inorder = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.erl = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.max_receive_data_len = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.first_burst_len = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.max_outstanding_r2t = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.max_burst_len = 0
Aug 26 22:27:05 user nova-compute[72929]: iface.chap_auth = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.bidi_chap = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.strict_login_compliance = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.discovery_auth = <empty>
Aug 26 22:27:05 user nova-compute[72929]: iface.discovery_logout = <empty>
Aug 26 22:27:05 user nova-compute[72929]: node.discovery_address = <empty>
Aug 26 22:27:05 user nova-compute[72929]: node.discovery_port = 0
Aug 26 22:27:05 user nova-compute[72929]: node.discovery_type = static
Aug 26 22:27:05 user nova-compute[72929]: node.session.initial_cmdsn = 0
Aug 26 22:27:05 user nova-compute[72929]: node.session.initial_login_retry_max = 8
Aug 26 22:27:05 user nova-compute[72929]: node.session.xmit_thread_priority = -20
Aug 26 22:27:05 user nova-compute[72929]: node.session.cmds_max = 128
Aug 26 22:27:05 user nova-compute[72929]: node.session.queue_depth = 32
Aug 26 22:27:05 user nova-compute[72929]: node.session.nr_sessions = 1
Aug 26 22:27:05 user nova-compute[72929]: node.session.auth.authmethod = CHAP
Aug 26 22:27:05 user nova-compute[72929]: node.session.auth.username = cjskGSbQ
Aug 26 22:27:05 user nova-compute[72929]: node.session.auth.password = ***
Aug 26 22:27:05 user nova-compute[72929]: node.session.auth.username_in = <empty>
Aug 26 22:27:05 user nova-compute[72929]: node.session.auth.password_in = <empty>
Aug 26 22:27:05 user nova-compute[72929]: node.session.auth.chap_algs = MD5
Aug 26 22:27:05 user nova-compute[72929]: node.session.timeo.replacement_timeout = 120
Aug 26 22:27:05 user nova-compute[72929]: node.session.err_timeo.abort_timeout = 15
Aug 26 22:27:05 user nova-compute[72929]: node.session.err_timeo.lu_reset_timeout = 30
Aug 26 22:27:05 user nova-compute[72929]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 26 22:27:05 user nova-compute[72929]: node.session.err_timeo.host_reset_timeout = 60
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.FastAbort = Yes
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.InitialR2T = No
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.ImmediateData = Yes
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.FirstBurstLength = 262144
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.MaxBurstLength = 16776192
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.DefaultTime2Retain = 0
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.DefaultTime2Wait = 2
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.MaxConnections = 1
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 26 22:27:05 user nova-compute[72929]: node.session.iscsi.ERL = 0
Aug 26 22:27:05 user nova-compute[72929]: node.session.scan = manual
Aug 26 22:27:05 user nova-compute[72929]: node.session.reopen_max = 0
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].address = 172.16.0.220
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].port = 3260
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].startup = manual
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].tcp.window_size = 524288
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].tcp.type_of_service = 0
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].timeo.logout_timeout = 15
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].timeo.login_timeout = 15
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].timeo.auth_timeout = 45
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].timeo.noop_out_interval = 5
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].timeo.noop_out_timeout = 5
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].iscsi.HeaderDigest = None
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].iscsi.DataDigest = None
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].iscsi.IFMarker = No
Aug 26 22:27:05 user nova-compute[72929]: node.conn[0].iscsi.OFMarker = No
Aug 26 22:27:05 user nova-compute[72929]: # END RECORD
Aug 26 22:27:05 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5003ea-9bc9-4131-a376-21114608f5e8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f84de-1100-4582-b84b-f9ae9233d86e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjskGSbQ {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjskGSbQ" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc9b8f-8435-47ad-95a8-dce687beb68c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cjskGSbQ'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c10c9-3825-40d6-a3f9-ce1bf6d740e5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1f3865-6527-474c-bc09-f088db3d9bab]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:27:05 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:27:05 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:27:05 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:27:05 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.182s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] HCTL ('37', '0', '0', 0) found on session 53 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88d9a75-081d-4f97-a5e0-d61ee352253e]: (4, ('0 0 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Searching for a device in session 53 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '26664333731663437', 'path': '/dev/sdf'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664333731663437', 'path': '/dev/sdf'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-196411701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-196411701',id=47,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-k3f5mxv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:25:40Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=b7993d49-af45-433e-8676-38ec3e12960f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "vif_mac": "fa:16:3e:de:e9:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "vif_mac": "fa:16:3e:de:e9:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.instance [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'pci_devices' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.objects.base [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Object Instance<b7993d49-af45-433e-8676-38ec3e12960f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=72929) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:27:05 user nova-compute[72929]:   <uuid>b7993d49-af45-433e-8676-38ec3e12960f</uuid>
Aug 26 22:27:05 user nova-compute[72929]:   <name>instance-0000002f</name>
Aug 26 22:27:05 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:27:05 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:27:05 user nova-compute[72929]:   <metadata>
Aug 26 22:27:05 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:27:05 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:27:05 user nova-compute[72929]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-196411701</nova:name>
Aug 26 22:27:05 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:27:05</nova:creationTime>
Aug 26 22:27:05 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:27:05 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:27:05 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:27:05 user nova-compute[72929]:       <nova:owner>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:user uuid="cc2833663e85431fa3433a128520c8a8">tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member</nova:user>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:project uuid="dcc89a603c20492d9a2f41085f0e10f5">tempest-ServerBootFromVolumeStableRescueTest-650830425</nova:project>
Aug 26 22:27:05 user nova-compute[72929]:       </nova:owner>
Aug 26 22:27:05 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:27:05 user nova-compute[72929]:       <nova:ports>
Aug 26 22:27:05 user nova-compute[72929]:         <nova:port uuid="9d101a1a-3dc1-493f-bbb9-649aabca0df7">
Aug 26 22:27:05 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 26 22:27:05 user nova-compute[72929]:         </nova:port>
Aug 26 22:27:05 user nova-compute[72929]:       </nova:ports>
Aug 26 22:27:05 user nova-compute[72929]:     </nova:instance>
Aug 26 22:27:05 user nova-compute[72929]:   </metadata>
Aug 26 22:27:05 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:27:05 user nova-compute[72929]:     <system>
Aug 26 22:27:05 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:27:05 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:27:05 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:27:05 user nova-compute[72929]:       <entry name="serial">b7993d49-af45-433e-8676-38ec3e12960f</entry>
Aug 26 22:27:05 user nova-compute[72929]:       <entry name="uuid">b7993d49-af45-433e-8676-38ec3e12960f</entry>
Aug 26 22:27:05 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:27:05 user nova-compute[72929]:     </system>
Aug 26 22:27:05 user nova-compute[72929]:   </sysinfo>
Aug 26 22:27:05 user nova-compute[72929]:   <os>
Aug 26 22:27:05 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:27:05 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:27:05 user nova-compute[72929]:   </os>
Aug 26 22:27:05 user nova-compute[72929]:   <features>
Aug 26 22:27:05 user nova-compute[72929]:     <acpi/>
Aug 26 22:27:05 user nova-compute[72929]:     <apic/>
Aug 26 22:27:05 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:27:05 user nova-compute[72929]:   </features>
Aug 26 22:27:05 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:27:05 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:27:05 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:27:05 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:27:05 user nova-compute[72929]:   </clock>
Aug 26 22:27:05 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:27:05 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:27:05 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:27:05 user nova-compute[72929]:   </cpu>
Aug 26 22:27:05 user nova-compute[72929]:   <devices>
Aug 26 22:27:05 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:27:05 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:27:05 user nova-compute[72929]:       <source dev="/dev/sdf"/>
Aug 26 22:27:05 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:27:05 user nova-compute[72929]:       <serial>ffba64a1-49e9-4eb3-84a4-f56b6d40efa6</serial>
Aug 26 22:27:05 user nova-compute[72929]:     </disk>
Aug 26 22:27:05 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:27:05 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:27:05 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue"/>
Aug 26 22:27:05 user nova-compute[72929]:       <target dev="vdb" bus="virtio"/>
Aug 26 22:27:05 user nova-compute[72929]:       <boot order="1"/>
Aug 26 22:27:05 user nova-compute[72929]:     </disk>
Aug 26 22:27:05 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:27:05 user nova-compute[72929]:       <mac address="fa:16:3e:de:e9:9c"/>
Aug 26 22:27:05 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:27:05 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:27:05 user nova-compute[72929]:       <target dev="tap9d101a1a-3d"/>
Aug 26 22:27:05 user nova-compute[72929]:     </interface>
Aug 26 22:27:05 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:27:05 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/console.log" append="off"/>
Aug 26 22:27:05 user nova-compute[72929]:     </serial>
Aug 26 22:27:05 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:27:05 user nova-compute[72929]:     <video>
Aug 26 22:27:05 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:27:05 user nova-compute[72929]:     </video>
Aug 26 22:27:05 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:27:05 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:27:05 user nova-compute[72929]:     </rng>
Aug 26 22:27:05 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:27:05 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:27:05 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:27:05 user nova-compute[72929]:     </memballoon>
Aug 26 22:27:05 user nova-compute[72929]:   </devices>
Aug 26 22:27:05 user nova-compute[72929]: </domain>
Aug 26 22:27:05 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:27:05 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance destroyed successfully.
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:27:05 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] No VIF found with MAC fa:16:3e:de:e9:9c, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a59d6576-0262-4c26-be85-22805728961d req-3abb5b12-b88a-4ec7-b9f0-113e0f60a6a0 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a59d6576-0262-4c26-be85-22805728961d req-3abb5b12-b88a-4ec7-b9f0-113e0f60a6a0 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a59d6576-0262-4c26-be85-22805728961d req-3abb5b12-b88a-4ec7-b9f0-113e0f60a6a0 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a59d6576-0262-4c26-be85-22805728961d req-3abb5b12-b88a-4ec7-b9f0-113e0f60a6a0 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-a59d6576-0262-4c26-be85-22805728961d req-3abb5b12-b88a-4ec7-b9f0-113e0f60a6a0 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:07 user nova-compute[72929]: WARNING nova.compute.manager [req-a59d6576-0262-4c26-be85-22805728961d req-3abb5b12-b88a-4ec7-b9f0-113e0f60a6a0 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state rescuing.
Aug 26 22:27:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for b7993d49-af45-433e-8676-38ec3e12960f due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088829.615509, b7993d49-af45-433e-8676-38ec3e12960f => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:27:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Resumed (Lifecycle Event)
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-6c995490-89d1-4279-8fa9-9ead7fb7c6a1 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:27:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088829.6183803, b7993d49-af45-433e-8676-38ec3e12960f => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:27:09 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Started (Lifecycle Event)
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3289431b-5d2f-4566-bac5-d9065a246436 req-5cd0f61f-62fc-42bf-b9f0-dfc734f24259 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3289431b-5d2f-4566-bac5-d9065a246436 req-5cd0f61f-62fc-42bf-b9f0-dfc734f24259 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3289431b-5d2f-4566-bac5-d9065a246436 req-5cd0f61f-62fc-42bf-b9f0-dfc734f24259 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3289431b-5d2f-4566-bac5-d9065a246436 req-5cd0f61f-62fc-42bf-b9f0-dfc734f24259 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [req-3289431b-5d2f-4566-bac5-d9065a246436 req-5cd0f61f-62fc-42bf-b9f0-dfc734f24259 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:09 user nova-compute[72929]: WARNING nova.compute.manager [req-3289431b-5d2f-4566-bac5-d9065a246436 req-5cd0f61f-62fc-42bf-b9f0-dfc734f24259 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state rescuing.
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:27:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Creating image(s)
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Ensure instance console log exists: /opt/stack/data/nova/instances/68a90e5d-acf6-4465-81f0-9ca7771548f2/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Start _get_guest_xml network_info=[{"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'bd308a1a-efb8-42fd-8fad-bc47dc32a9b9', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68a90e5d-acf6-4465-81f0-9ca7771548f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f845783e-a528-4e8a-8c71-854c428ef493', 'serial': 'f845783e-a528-4e8a-8c71-854c428ef493'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:27:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:27:10 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:27:10 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:27:10 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:27:10 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b14075e-d6a4-4ecb-a2ff-9ab864f41728]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:27:10 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e5294e-9a75-4fa6-9658-08d9a189f840]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493] added
Aug 26 22:27:10 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60082a-7311-47f9-9c39-34405f8ac9a3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7891ab08-2c94-41a6-8f3f-0b5a52782435]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdQWPxoA {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdQWPxoA" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e044b17-8b77-4271-a890-87f1ee5466c8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdQWPxoA'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d192514f-cd59-4f43-94d9-8d1c9b8d0a8f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8a244d-d616-41f5-be10-6e01ff287fbc]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:27:11 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:27:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:27:11 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:27:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5847db-74ab-4e42-a09f-95191f8fcaaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]
Aug 26 22:27:11 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.
Aug 26 22:27:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afb8f55-0412-4f22-9ddb-60bc19df2947]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ea43e-86c6-4c21-9972-57abf62718b1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:27:11 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:27:11 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:27:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:27:11 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:27:11 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:27:11 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9085831f-7ae3-458b-b272-1165f7078428]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:27:11 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23830643239323237', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830643239323237', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-748407826',display_name='tempest-TestVolumeBootPattern-server-748407826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-748407826',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-gr5ll2if',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:26:58Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=68a90e5d-acf6-4465-81f0-9ca7771548f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'pci_devices' on Instance uuid 68a90e5d-acf6-4465-81f0-9ca7771548f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:27:12 user nova-compute[72929]:   <uuid>68a90e5d-acf6-4465-81f0-9ca7771548f2</uuid>
Aug 26 22:27:12 user nova-compute[72929]:   <name>instance-00000031</name>
Aug 26 22:27:12 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:27:12 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:27:12 user nova-compute[72929]:   <metadata>
Aug 26 22:27:12 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:27:12 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:27:12 user nova-compute[72929]:       <nova:name>tempest-TestVolumeBootPattern-server-748407826</nova:name>
Aug 26 22:27:12 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:27:10</nova:creationTime>
Aug 26 22:27:12 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:27:12 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:27:12 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:27:12 user nova-compute[72929]:       <nova:owner>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:user uuid="cf31c30629f7485a9b160f8d853096dc">tempest-TestVolumeBootPattern-1716061349-project-member</nova:user>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:project uuid="ea6b106b16484bfa8fd629b57527130f">tempest-TestVolumeBootPattern-1716061349</nova:project>
Aug 26 22:27:12 user nova-compute[72929]:       </nova:owner>
Aug 26 22:27:12 user nova-compute[72929]:       <nova:ports>
Aug 26 22:27:12 user nova-compute[72929]:         <nova:port uuid="31b3f937-0174-48c1-b51f-09f1972e3746">
Aug 26 22:27:12 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 26 22:27:12 user nova-compute[72929]:         </nova:port>
Aug 26 22:27:12 user nova-compute[72929]:       </nova:ports>
Aug 26 22:27:12 user nova-compute[72929]:     </nova:instance>
Aug 26 22:27:12 user nova-compute[72929]:   </metadata>
Aug 26 22:27:12 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:27:12 user nova-compute[72929]:     <system>
Aug 26 22:27:12 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:27:12 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:27:12 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:27:12 user nova-compute[72929]:       <entry name="serial">68a90e5d-acf6-4465-81f0-9ca7771548f2</entry>
Aug 26 22:27:12 user nova-compute[72929]:       <entry name="uuid">68a90e5d-acf6-4465-81f0-9ca7771548f2</entry>
Aug 26 22:27:12 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:27:12 user nova-compute[72929]:     </system>
Aug 26 22:27:12 user nova-compute[72929]:   </sysinfo>
Aug 26 22:27:12 user nova-compute[72929]:   <os>
Aug 26 22:27:12 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:27:12 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:27:12 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:27:12 user nova-compute[72929]:   </os>
Aug 26 22:27:12 user nova-compute[72929]:   <features>
Aug 26 22:27:12 user nova-compute[72929]:     <acpi/>
Aug 26 22:27:12 user nova-compute[72929]:     <apic/>
Aug 26 22:27:12 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:27:12 user nova-compute[72929]:   </features>
Aug 26 22:27:12 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:27:12 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:27:12 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:27:12 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:27:12 user nova-compute[72929]:   </clock>
Aug 26 22:27:12 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:27:12 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:27:12 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:27:12 user nova-compute[72929]:   </cpu>
Aug 26 22:27:12 user nova-compute[72929]:   <devices>
Aug 26 22:27:12 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:27:12 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:27:12 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:27:12 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:27:12 user nova-compute[72929]:       <serial>f845783e-a528-4e8a-8c71-854c428ef493</serial>
Aug 26 22:27:12 user nova-compute[72929]:     </disk>
Aug 26 22:27:12 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:27:12 user nova-compute[72929]:       <mac address="fa:16:3e:94:67:be"/>
Aug 26 22:27:12 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:27:12 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:27:12 user nova-compute[72929]:       <target dev="tap31b3f937-01"/>
Aug 26 22:27:12 user nova-compute[72929]:     </interface>
Aug 26 22:27:12 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:27:12 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/68a90e5d-acf6-4465-81f0-9ca7771548f2/console.log" append="off"/>
Aug 26 22:27:12 user nova-compute[72929]:     </serial>
Aug 26 22:27:12 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:27:12 user nova-compute[72929]:     <video>
Aug 26 22:27:12 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:27:12 user nova-compute[72929]:     </video>
Aug 26 22:27:12 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:27:12 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:27:12 user nova-compute[72929]:     </rng>
Aug 26 22:27:12 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:27:12 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:27:12 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:27:12 user nova-compute[72929]:     </memballoon>
Aug 26 22:27:12 user nova-compute[72929]:   </devices>
Aug 26 22:27:12 user nova-compute[72929]: </domain>
Aug 26 22:27:12 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-748407826',display_name='tempest-TestVolumeBootPattern-server-748407826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-748407826',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-gr5ll2if',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:26:58Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=68a90e5d-acf6-4465-81f0-9ca7771548f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG os_vif [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31b3f937-01, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31b3f937-01, col_values=(('external_ids', {'iface-id': '31b3f937-0174-48c1-b51f-09f1972e3746', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:67:be', 'vm-uuid': '68a90e5d-acf6-4465-81f0-9ca7771548f2'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:12 user nova-compute[72929]: INFO os_vif [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01')
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:27:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No VIF found with MAC fa:16:3e:94:67:be, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-d33d9da2-776f-40dd-acd5-3d0dae9cad92 req-5bc947c4-9135-4303-b662-06d28d4f5396 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d33d9da2-776f-40dd-acd5-3d0dae9cad92 req-5bc947c4-9135-4303-b662-06d28d4f5396 service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d33d9da2-776f-40dd-acd5-3d0dae9cad92 req-5bc947c4-9135-4303-b662-06d28d4f5396 service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d33d9da2-776f-40dd-acd5-3d0dae9cad92 req-5bc947c4-9135-4303-b662-06d28d4f5396 service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:13 user nova-compute[72929]: DEBUG nova.compute.manager [req-d33d9da2-776f-40dd-acd5-3d0dae9cad92 req-5bc947c4-9135-4303-b662-06d28d4f5396 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:13 user nova-compute[72929]: WARNING nova.compute.manager [req-d33d9da2-776f-40dd-acd5-3d0dae9cad92 req-5bc947c4-9135-4303-b662-06d28d4f5396 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received unexpected event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with vm_state building and task_state spawning.
Aug 26 22:27:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-d98a2633-4aeb-4f92-87d6-14fbc8a0db91 req-bf8e1282-7174-4c2b-999e-1e70081bfa61 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d98a2633-4aeb-4f92-87d6-14fbc8a0db91 req-bf8e1282-7174-4c2b-999e-1e70081bfa61 service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d98a2633-4aeb-4f92-87d6-14fbc8a0db91 req-bf8e1282-7174-4c2b-999e-1e70081bfa61 service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d98a2633-4aeb-4f92-87d6-14fbc8a0db91 req-bf8e1282-7174-4c2b-999e-1e70081bfa61 service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-d98a2633-4aeb-4f92-87d6-14fbc8a0db91 req-bf8e1282-7174-4c2b-999e-1e70081bfa61 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:16 user nova-compute[72929]: WARNING nova.compute.manager [req-d98a2633-4aeb-4f92-87d6-14fbc8a0db91 req-bf8e1282-7174-4c2b-999e-1e70081bfa61 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received unexpected event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with vm_state building and task_state spawning.
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088836.0578845, 68a90e5d-acf6-4465-81f0-9ca7771548f2 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] VM Resumed (Lifecycle Event)
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Instance spawned successfully.
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088836.0614643, 68a90e5d-acf6-4465-81f0-9ca7771548f2 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] VM Started (Lifecycle Event)
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 26 22:27:16 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:27:16 user nova-compute[72929]: INFO nova.compute.manager [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Took 19.09 seconds to build instance.
Aug 26 22:27:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4e265692-a6a8-43e4-97a2-8461f5245d48 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.207s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:21 user nova-compute[72929]: INFO nova.compute.manager [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Terminating instance
Aug 26 22:27:21 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-d6833eab-3c23-49ff-ac03-ec461628412a req-7e2eb456-5927-4e61-a64b-b80e09e43ff3 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-unplugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d6833eab-3c23-49ff-ac03-ec461628412a req-7e2eb456-5927-4e61-a64b-b80e09e43ff3 service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d6833eab-3c23-49ff-ac03-ec461628412a req-7e2eb456-5927-4e61-a64b-b80e09e43ff3 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d6833eab-3c23-49ff-ac03-ec461628412a req-7e2eb456-5927-4e61-a64b-b80e09e43ff3 service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-d6833eab-3c23-49ff-ac03-ec461628412a req-7e2eb456-5927-4e61-a64b-b80e09e43ff3 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-unplugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG nova.compute.manager [req-d6833eab-3c23-49ff-ac03-ec461628412a req-7e2eb456-5927-4e61-a64b-b80e09e43ff3 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-unplugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:27:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Instance destroyed successfully.
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lazy-loading 'resources' on Instance uuid 6426d900-d9c6-464e-aac3-a22392b39f9c {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1677838787',display_name='tempest-TestMinimumBasicScenario-server-1677838787',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1677838787',id=42,image_ref='f0384cef-6413-49d1-a0ab-3bebdd3d01f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6fIxIdG01+r8cfZ2zGASTyVoZ1Vs+p+S9HEIuXWWNT1fqYEFvFdb++a37XNWH9kLn+colDRYhrOdacw40ykKhb8myBFn5rgK+rNjMmkynOw3p77c/sdeFMxwwttZZEwQ==',key_name='tempest-TestMinimumBasicScenario-1934305128',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='01b4cbef9286450aba00ce7ebd1cd360',ramdisk_id='',reservation_id='r-pnhmx0ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f0384cef-6413-49d1-a0ab-3bebdd3d01f6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1162639748',owner_user_name='tempest-TestMinimumBasicScenario-1162639748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:24:37Z,user_data=None,user_id='288d81e675df48b399f1635e05700193',uuid=6426d900-d9c6-464e-aac3-a22392b39f9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converting VIF {"id": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "address": "fa:16:3e:79:55:7f", "network": {"id": "8d4b8aa6-d640-4f45-a3ee-9700e0ade613", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-477146471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "01b4cbef9286450aba00ce7ebd1cd360", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb64b410-f8", "ovs_interfaceid": "fb64b410-f883-4c5b-ba7d-b8374d1ff579", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG os_vif [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb64b410-f8, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:27:22 user nova-compute[72929]: INFO os_vif [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:55:7f,bridge_name='br-int',has_traffic_filtering=True,id=fb64b410-f883-4c5b-ba7d-b8374d1ff579,network=Network(8d4b8aa6-d640-4f45-a3ee-9700e0ade613),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb64b410-f8')
Aug 26 22:27:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Deleting instance files /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c_del
Aug 26 22:27:22 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Deletion of /opt/stack/data/nova/instances/6426d900-d9c6-464e-aac3-a22392b39f9c_del complete
Aug 26 22:27:22 user nova-compute[72929]: INFO nova.compute.manager [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 26 22:27:22 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:27:22 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Took 0.76 seconds to deallocate network for instance.
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-57cdd698-d1b5-4b90-8d96-7f229137d295 req-175e942f-a85c-49ab-8beb-192bd05caa33 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-deleted-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:22 user nova-compute[72929]: INFO nova.compute.manager [req-57cdd698-d1b5-4b90-8d96-7f229137d295 req-175e942f-a85c-49ab-8beb-192bd05caa33 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Neutron deleted interface fb64b410-f883-4c5b-ba7d-b8374d1ff579; detaching it from the instance and deleting it from the info cache
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.network.neutron [req-57cdd698-d1b5-4b90-8d96-7f229137d295 req-175e942f-a85c-49ab-8beb-192bd05caa33 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG nova.compute.manager [req-57cdd698-d1b5-4b90-8d96-7f229137d295 req-175e942f-a85c-49ab-8beb-192bd05caa33 service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Detach interface failed, port_id=fb64b410-f883-4c5b-ba7d-b8374d1ff579, reason: Instance 6426d900-d9c6-464e-aac3-a22392b39f9c could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:22 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:23 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Deleted allocations for instance 6426d900-d9c6-464e-aac3-a22392b39f9c
Aug 26 22:27:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f5a6154c-fdfc-444b-a933-d360211e6fcd tempest-TestMinimumBasicScenario-1162639748 tempest-TestMinimumBasicScenario-1162639748-project-member] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-60f9aea9-502a-4f83-9670-f07f5b6991a1 req-d2d58575-e85e-4d09-9cc4-4d4889db994f service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-60f9aea9-502a-4f83-9670-f07f5b6991a1 req-d2d58575-e85e-4d09-9cc4-4d4889db994f service nova] Acquiring lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-60f9aea9-502a-4f83-9670-f07f5b6991a1 req-d2d58575-e85e-4d09-9cc4-4d4889db994f service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-60f9aea9-502a-4f83-9670-f07f5b6991a1 req-d2d58575-e85e-4d09-9cc4-4d4889db994f service nova] Lock "6426d900-d9c6-464e-aac3-a22392b39f9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:23 user nova-compute[72929]: DEBUG nova.compute.manager [req-60f9aea9-502a-4f83-9670-f07f5b6991a1 req-d2d58575-e85e-4d09-9cc4-4d4889db994f service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] No waiting events found dispatching network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:27:23 user nova-compute[72929]: WARNING nova.compute.manager [req-60f9aea9-502a-4f83-9670-f07f5b6991a1 req-d2d58575-e85e-4d09-9cc4-4d4889db994f service nova] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Received unexpected event network-vif-plugged-fb64b410-f883-4c5b-ba7d-b8374d1ff579 for instance with vm_state deleted and task_state None.
Aug 26 22:27:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:37 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088841.9998078, 6426d900-d9c6-464e-aac3-a22392b39f9c => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:27:37 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] VM Stopped (Lifecycle Event)
Aug 26 22:27:37 user nova-compute[72929]: DEBUG nova.compute.manager [None req-d3cbe0d7-4037-49aa-ab08-e97af8ce1155 None None] [instance: 6426d900-d9c6-464e-aac3-a22392b39f9c] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:27:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:38 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:27:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:27:40 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:27:40 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:27:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating instance_info_cache with network_info: [{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:27:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:27:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:27:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:27:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:27:45 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:27:45 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=7939MB free_disk=23.649852752685547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b7993d49-af45-433e-8676-38ec3e12960f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5aee272f-0f8e-4933-bb08-0ec213add04b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 68a90e5d-acf6-4465-81f0-9ca7771548f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:27:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:27:46 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:27:46 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:27:46 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:27:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:27:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:27:53 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:53 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:27:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:28:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:28:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:28:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:28:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:07 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:12 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:17 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:22 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:27 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:37 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:28:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-changed-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:37 user nova-compute[72929]: DEBUG nova.compute.manager [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Refreshing instance network info cache due to event network-changed-286b78ad-c592-4a4c-91ff-291a7a1c1bf8. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:28:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] Acquiring lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:28:37 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] Acquired lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:28:37 user nova-compute[72929]: DEBUG nova.network.neutron [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Refreshing network info cache for port 286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG nova.network.neutron [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updated VIF entry in instance network info cache for port 286b78ad-c592-4a4c-91ff-291a7a1c1bf8. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG nova.network.neutron [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating instance_info_cache with network_info: [{"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-0bfad6b6-b74c-4024-8b2c-c3b9ef425d1b req-97d3ef2c-c512-4355-a734-ab60c78fd074 service nova] Releasing lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG nova.objects.instance [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'flavor' on Instance uuid 5aee272f-0f8e-4933-bb08-0ec213add04b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:38 user nova-compute[72929]: INFO nova.compute.manager [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Attaching volume b1dd176e-0a83-4520-83fa-00bd317ca42f to /dev/vdb
Aug 26 22:28:38 user nova-compute[72929]: DEBUG os_brick.utils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e0fe1-26c8-4cff-99ec-519d9e618168]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9299f4-46d5-4b21-8c4f-21fdbcc49130]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23d80cc-62bc-4e44-8c9a-d64337804ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc376ce9-27ab-473f-afa3-4ed2729e5bd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:28:38 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:28:38 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e48ea7-37ae-4ac0-bf05-a11519204931]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG os_brick.utils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating existing volume attachment record: cb2a16b4-e59f-450e-abc0-673a2f2d78fe {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:28:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:40 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:41 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:28:42 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:28:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:28:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:28:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8118MB free_disk=23.68710708618164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b7993d49-af45-433e-8676-38ec3e12960f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 5aee272f-0f8e-4933-bb08-0ec213add04b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 68a90e5d-acf6-4465-81f0-9ca7771548f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-changed-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Refreshing instance network info cache due to event network-changed-31b3f937-0174-48c1-b51f-09f1972e3746. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:28:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] Acquiring lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:28:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] Acquired lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:28:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Refreshing network info cache for port 31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.network.neutron [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updated VIF entry in instance network info cache for port 31b3f937-0174-48c1-b51f-09f1972e3746. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.network.neutron [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updating instance_info_cache with network_info: [{"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bb6f8211-0df6-4f52-a533-980d31e3a3a9 req-fbfc2226-7968-4fbd-9c5e-d67bffa7e691 service nova] Releasing lock "refresh_cache-68a90e5d-acf6-4465-81f0-9ca7771548f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:50 user nova-compute[72929]: INFO nova.compute.manager [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Terminating instance
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLBeKAWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:28:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:28:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:28:50 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff279a6b-57a9-431a-8537-96e743b68d67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:28:50 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077d46d-74ab-4f08-8da6-097996e04fc0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f] added
Aug 26 22:28:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0c78b6-fc57-4fd6-960d-cdfaf562ccca]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc125889-7fae-49b5-99cc-46b355fa43e2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLBeKAWS {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLBeKAWS" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e35219-a32f-44f1-816f-c68bc334d360]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vLBeKAWS'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3856ea4-0117-44f6-bc78-d660a67a8c83]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fbcf84-d114-41eb-9619-717cf1f7a035]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3493dc-8d98-4412-a51e-f4ec9ab9b7f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260]
Aug 26 22:28:50 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260] successful.
Aug 26 22:28:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[948e04da-35d4-4c8d-94e0-bf885b4a6c0d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b10528-7d09-4123-b9f1-af119f98af25]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)
Aug 26 22:28:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:28:50 user nova-compute[72929]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)
Aug 26 22:28:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f72e06-d21d-48c3-9dd4-3419a269e3ba]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLBeKAWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Instance destroyed successfully.
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.objects.instance [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'resources' on Instance uuid 68a90e5d-acf6-4465-81f0-9ca7771548f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:26:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-748407826',display_name='tempest-TestVolumeBootPattern-server-748407826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-748407826',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:27:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-gr5ll2if',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:27:16Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=68a90e5d-acf6-4465-81f0-9ca7771548f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "31b3f937-0174-48c1-b51f-09f1972e3746", "address": "fa:16:3e:94:67:be", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31b3f937-01", "ovs_interfaceid": "31b3f937-0174-48c1-b51f-09f1972e3746", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_vif [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31b3f937-01, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:28:50 user nova-compute[72929]: INFO os_vif [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:67:be,bridge_name='br-int',has_traffic_filtering=True,id=31b3f937-0174-48c1-b51f-09f1972e3746,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31b3f937-01')
Aug 26 22:28:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:28:50 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:28:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:28:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23362333961343531', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362333961343531', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.596s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.objects.instance [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'flavor' on Instance uuid 5aee272f-0f8e-4933-bb08-0ec213add04b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[65763ae1-9552-42c4-a51d-272e2b83ef2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:28:51 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:28:51 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:28:51 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:28:51 user nova-compute[72929]:   <serial>b1dd176e-0a83-4520-83fa-00bd317ca42f</serial>
Aug 26 22:28:51 user nova-compute[72929]: </disk>
Aug 26 22:28:51 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fc4a70-9844-41b2-9445-8635df9a2dc7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:51 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:51 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:28:51 user nova-compute[72929]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)
Aug 26 22:28:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:51 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:51 user nova-compute[72929]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:28:51 user nova-compute[72929]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)
Aug 26 22:28:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b80720940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.058s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fea4420-765e-4555-9d92-5de72f2e28eb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-unplugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-unplugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-unplugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:51 user nova-compute[72929]: WARNING nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received unexpected event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with vm_state active and task_state deleting.
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:51 user nova-compute[72929]: WARNING nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received unexpected event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with vm_state active and task_state deleting.
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:51 user nova-compute[72929]: WARNING nova.compute.manager [req-37259c65-c613-4d9c-b4d4-4834c6f2c489 req-30a435b3-0892-47d0-a51f-6ac5b85ffcba service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received unexpected event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with vm_state active and task_state deleting.
Aug 26 22:28:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57a854-9bde-4841-a6b4-522c4c67356f]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f905a7-94fb-4f40-8c9f-f27a394240f3]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe76c2a-5fd0-4acb-b77d-c8503437fe9b]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fee9f1-0634-45fe-880b-b2c6f4d23088]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[264c46f3-8207-44f8-977f-0535bc775326]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]
Aug 26 22:28:51 user nova-compute[72929]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.
Aug 26 22:28:51 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b879aa04-640b-4ab5-a014-cdaf01cd298c]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== disconnect_volume: return (952ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:28:51 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Deleting instance files /opt/stack/data/nova/instances/68a90e5d-acf6-4465-81f0-9ca7771548f2_del
Aug 26 22:28:51 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Deletion of /opt/stack/data/nova/instances/68a90e5d-acf6-4465-81f0-9ca7771548f2_del complete
Aug 26 22:28:51 user nova-compute[72929]: INFO nova.compute.manager [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Took 1.84 seconds to destroy the instance on the hypervisor.
Aug 26 22:28:51 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:28:51 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] No VIF found with MAC fa:16:3e:c5:f6:bc, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:28:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-670fe96a-4354-4529-98dc-a809fbe6f455 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.370s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:52 user nova-compute[72929]: INFO nova.compute.manager [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Unrescuing
Aug 26 22:28:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:28:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquired lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:28:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:28:52 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:28:52 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Took 0.96 seconds to deallocate network for instance.
Aug 26 22:28:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-243f71d9-8495-4e6a-ab22-a51c8f3cbbf5 req-66485d02-c003-4e00-99f9-d1593676fbcd service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-deleted-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating instance_info_cache with network_info: [{"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Releasing lock "refresh_cache-b7993d49-af45-433e-8676-38ec3e12960f" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.objects.instance [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'flavor' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-unplugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-unplugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-unplugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] Acquiring lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG nova.compute.manager [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] No waiting events found dispatching network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:53 user nova-compute[72929]: WARNING nova.compute.manager [req-680b1169-65a5-483e-b766-47d8e0184735 req-15e4f480-9175-4fb9-8abd-569018cf9c6f service nova] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Received unexpected event network-vif-plugged-31b3f937-0174-48c1-b51f-09f1972e3746 for instance with vm_state active and task_state deleting.
Aug 26 22:28:53 user nova-compute[72929]: INFO nova.compute.manager [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Took 0.85 seconds to detach 1 volumes for instance.
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance destroyed successfully.
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:53 user nova-compute[72929]: INFO nova.compute.manager [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Detaching volume b1dd176e-0a83-4520-83fa-00bd317ca42f
Aug 26 22:28:54 user nova-compute[72929]: INFO nova.virt.block_device [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Attempting to driver detach volume b1dd176e-0a83-4520-83fa-00bd317ca42f from mountpoint /dev/vdb
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Attempting to detach device vdb from instance 5aee272f-0f8e-4933-bb08-0ec213add04b from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:28:54 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:28:54 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:28:54 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:28:54 user nova-compute[72929]:   <serial>b1dd176e-0a83-4520-83fa-00bd317ca42f</serial>
Aug 26 22:28:54 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:28:54 user nova-compute[72929]: </disk>
Aug 26 22:28:54 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:28:54 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully detached device vdb from instance 5aee272f-0f8e-4933-bb08-0ec213add04b from the persistent domain config.
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5aee272f-0f8e-4933-bb08-0ec213add04b from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:28:54 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:28:54 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:28:54 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:28:54 user nova-compute[72929]:   <serial>b1dd176e-0a83-4520-83fa-00bd317ca42f</serial>
Aug 26 22:28:54 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:28:54 user nova-compute[72929]: </disk>
Aug 26 22:28:54 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:54 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Deleted allocations for instance 68a90e5d-acf6-4465-81f0-9ca7771548f2
Aug 26 22:28:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-b9bcf3a4-548c-4ee3-af3d-f85ece4318a9 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "68a90e5d-acf6-4465-81f0-9ca7771548f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.230s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693088934.5626006, 5aee272f-0f8e-4933-bb08-0ec213add04b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5aee272f-0f8e-4933-bb08-0ec213add04b {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:28:54 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully detached device vdb from instance 5aee272f-0f8e-4933-bb08-0ec213add04b from the live domain config.
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLBeKAWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:28:54 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[029134da-49e2-4c00-be5d-a91135cba5ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d4b363-6e4e-4d6f-b585-fd05a2dd848d]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:54 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:54 user nova-compute[72929]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)
Aug 26 22:28:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:28:54 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:28:54 user nova-compute[72929]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f (non-flash)
Aug 26 22:28:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803b1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[92145873-2243-4aa7-8e63-4cb1d472efe2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a46beb-0e03-45cb-a024-b7db76af445b]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb78e50-0fc3-474c-9bad-2d199b09b283]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f904078-4a4a-498b-a66c-6f232c67632c]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88aec9d-a1f5-40c6-9859-dc277de96800]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9d8102-34d7-416d-9de2-820fd73657e2]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260]
Aug 26 22:28:54 user nova-compute[72929]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f, portal: 172.16.0.220,3260] successful.
Aug 26 22:28:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1dd176e-0a83-4520-83fa-00bd317ca42f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34f462-b1b0-49e7-a807-e1748680487b]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] <== disconnect_volume: return (272ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:28:54 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG nova.objects.instance [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'flavor' on Instance uuid 5aee272f-0f8e-4933-bb08-0ec213add04b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-1d639988-fb50-4aa0-81ea-d4356b339a81 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.779s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Removed pending event for b7993d49-af45-433e-8676-38ec3e12960f due to event {{(pid=72929) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088937.5454855, b7993d49-af45-433e-8676-38ec3e12960f => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:28:57 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Resumed (Lifecycle Event)
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-beff568a-3dc0-4d77-8582-8bdb37daefca tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:28:57 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088937.5465527, b7993d49-af45-433e-8676-38ec3e12960f => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:28:57 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Started (Lifecycle Event)
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:28:57 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:28:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:28:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-38951c10-7723-417c-b180-36d2ee52dbeb req-4258f8b3-5da5-4229-8a0c-75fd59d94db6 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:28:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-38951c10-7723-417c-b180-36d2ee52dbeb req-4258f8b3-5da5-4229-8a0c-75fd59d94db6 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:28:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-38951c10-7723-417c-b180-36d2ee52dbeb req-4258f8b3-5da5-4229-8a0c-75fd59d94db6 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:28:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-38951c10-7723-417c-b180-36d2ee52dbeb req-4258f8b3-5da5-4229-8a0c-75fd59d94db6 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:28:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-38951c10-7723-417c-b180-36d2ee52dbeb req-4258f8b3-5da5-4229-8a0c-75fd59d94db6 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:28:59 user nova-compute[72929]: WARNING nova.compute.manager [req-38951c10-7723-417c-b180-36d2ee52dbeb req-4258f8b3-5da5-4229-8a0c-75fd59d94db6 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state None.
Aug 26 22:29:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:01 user nova-compute[72929]: WARNING nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state None.
Aug 26 22:29:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:01 user nova-compute[72929]: WARNING nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state None.
Aug 26 22:29:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:01 user nova-compute[72929]: DEBUG nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:01 user nova-compute[72929]: WARNING nova.compute.manager [req-18c8fd49-5ad0-4986-a1a9-0df3186c6374 req-8bb82b36-5f79-42bf-be20-92143c4dcf99 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state None.
Aug 26 22:29:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:02 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:29:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:29:02 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:29:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088930.8340821, 68a90e5d-acf6-4465-81f0-9ca7771548f2 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:29:05 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] VM Stopped (Lifecycle Event)
Aug 26 22:29:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef0e425a-5441-4557-805c-d10588d66182 None None] [instance: 68a90e5d-acf6-4465-81f0-9ca7771548f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:05 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:29:05 user nova-compute[72929]: INFO nova.compute.claims [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Claim successful on node user
Aug 26 22:29:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:29:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.policy [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9aebd4001cf54f8c8114ab742f4242ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909e305b15ed42f8825eaa3d4c51057d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:29:06 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Creating image(s)
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "/opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "/opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "/opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.174s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk 1073741824 {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051,backing_fmt=raw /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk 1073741824" returned: 0 in 0.062s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bb23afc88b697142003c0bd924a7bd6e4b9a0051" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:06 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051 --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk. size=1073741824 {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG nova.virt.disk.api [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Cannot resize image /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk to a smaller size. {{(pid=72929) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Created local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Ensure instance console log exists: /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:07 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Successfully created port: 4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Successfully updated port: 4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquired lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-changed-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.compute.manager [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Refreshing instance network info cache due to event network-changed-4c193bab-16ea-4313-bbdf-5c8a78f1543f. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] Acquiring lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.neutron [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updating instance_info_cache with network_info: [{"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Releasing lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Instance network_info: |[{"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] Acquired lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.neutron [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Refreshing network info cache for port 4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Start _get_guest_xml network_info=[{"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_options': None, 'image_id': '004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:29:08 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:29:08 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-26T21:53:37Z,direct_url=<?>,disk_format='qcow2',id=004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='ef4acd3cbba8442a9c306f53fe0c7067',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-26T21:53:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2096110074',display_name='tempest-TestServerVolumeAttachmentScenario-server-2096110074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2096110074',id=50,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaIhi7MJ1f/Th+mIkNVrZ50Xxqk9FvNZFn354V9udtpF6JF4vKAByKU3e6CZaRv7O73W35rISuj0/XjeAu/geXtKOejcgWCcdbb6s4PBSyMrxqznxwJlrv+zfGCx04xsQ==',key_name='tempest-keypair-477967582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909e305b15ed42f8825eaa3d4c51057d',ramdisk_id='',reservation_id='r-spa809fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1100081246',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1100081246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aebd4001cf54f8c8114ab742f4242ec',uuid=bbb086c5-5794-4855-ab1e-fec50e12751e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Converting VIF {"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.objects.instance [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'pci_devices' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:29:08 user nova-compute[72929]:   <uuid>bbb086c5-5794-4855-ab1e-fec50e12751e</uuid>
Aug 26 22:29:08 user nova-compute[72929]:   <name>instance-00000032</name>
Aug 26 22:29:08 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:29:08 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:29:08 user nova-compute[72929]:   <metadata>
Aug 26 22:29:08 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:29:08 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:29:08 user nova-compute[72929]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2096110074</nova:name>
Aug 26 22:29:08 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:29:08</nova:creationTime>
Aug 26 22:29:08 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:29:08 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:29:08 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:29:08 user nova-compute[72929]:       <nova:owner>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:user uuid="9aebd4001cf54f8c8114ab742f4242ec">tempest-TestServerVolumeAttachmentScenario-1100081246-project-member</nova:user>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:project uuid="909e305b15ed42f8825eaa3d4c51057d">tempest-TestServerVolumeAttachmentScenario-1100081246</nova:project>
Aug 26 22:29:08 user nova-compute[72929]:       </nova:owner>
Aug 26 22:29:08 user nova-compute[72929]:       <nova:root type="image" uuid="004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3"/>
Aug 26 22:29:08 user nova-compute[72929]:       <nova:ports>
Aug 26 22:29:08 user nova-compute[72929]:         <nova:port uuid="4c193bab-16ea-4313-bbdf-5c8a78f1543f">
Aug 26 22:29:08 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 26 22:29:08 user nova-compute[72929]:         </nova:port>
Aug 26 22:29:08 user nova-compute[72929]:       </nova:ports>
Aug 26 22:29:08 user nova-compute[72929]:     </nova:instance>
Aug 26 22:29:08 user nova-compute[72929]:   </metadata>
Aug 26 22:29:08 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:29:08 user nova-compute[72929]:     <system>
Aug 26 22:29:08 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:29:08 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:29:08 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:29:08 user nova-compute[72929]:       <entry name="serial">bbb086c5-5794-4855-ab1e-fec50e12751e</entry>
Aug 26 22:29:08 user nova-compute[72929]:       <entry name="uuid">bbb086c5-5794-4855-ab1e-fec50e12751e</entry>
Aug 26 22:29:08 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:29:08 user nova-compute[72929]:     </system>
Aug 26 22:29:08 user nova-compute[72929]:   </sysinfo>
Aug 26 22:29:08 user nova-compute[72929]:   <os>
Aug 26 22:29:08 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:29:08 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:29:08 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:29:08 user nova-compute[72929]:   </os>
Aug 26 22:29:08 user nova-compute[72929]:   <features>
Aug 26 22:29:08 user nova-compute[72929]:     <acpi/>
Aug 26 22:29:08 user nova-compute[72929]:     <apic/>
Aug 26 22:29:08 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:29:08 user nova-compute[72929]:   </features>
Aug 26 22:29:08 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:29:08 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:29:08 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:29:08 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:29:08 user nova-compute[72929]:   </clock>
Aug 26 22:29:08 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:29:08 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:29:08 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:29:08 user nova-compute[72929]:   </cpu>
Aug 26 22:29:08 user nova-compute[72929]:   <devices>
Aug 26 22:29:08 user nova-compute[72929]:     <disk type="file" device="disk">
Aug 26 22:29:08 user nova-compute[72929]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 26 22:29:08 user nova-compute[72929]:       <source file="/opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk"/>
Aug 26 22:29:08 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:29:08 user nova-compute[72929]:     </disk>
Aug 26 22:29:08 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:29:08 user nova-compute[72929]:       <mac address="fa:16:3e:9e:4d:fe"/>
Aug 26 22:29:08 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:29:08 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:29:08 user nova-compute[72929]:       <target dev="tap4c193bab-16"/>
Aug 26 22:29:08 user nova-compute[72929]:     </interface>
Aug 26 22:29:08 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:29:08 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/console.log" append="off"/>
Aug 26 22:29:08 user nova-compute[72929]:     </serial>
Aug 26 22:29:08 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:29:08 user nova-compute[72929]:     <video>
Aug 26 22:29:08 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:29:08 user nova-compute[72929]:     </video>
Aug 26 22:29:08 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:29:08 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:29:08 user nova-compute[72929]:     </rng>
Aug 26 22:29:08 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:29:08 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:29:08 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:29:08 user nova-compute[72929]:     </memballoon>
Aug 26 22:29:08 user nova-compute[72929]:   </devices>
Aug 26 22:29:08 user nova-compute[72929]: </domain>
Aug 26 22:29:08 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2096110074',display_name='tempest-TestServerVolumeAttachmentScenario-server-2096110074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2096110074',id=50,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaIhi7MJ1f/Th+mIkNVrZ50Xxqk9FvNZFn354V9udtpF6JF4vKAByKU3e6CZaRv7O73W35rISuj0/XjeAu/geXtKOejcgWCcdbb6s4PBSyMrxqznxwJlrv+zfGCx04xsQ==',key_name='tempest-keypair-477967582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909e305b15ed42f8825eaa3d4c51057d',ramdisk_id='',reservation_id='r-spa809fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1100081246',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1100081246-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:29:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aebd4001cf54f8c8114ab742f4242ec',uuid=bbb086c5-5794-4855-ab1e-fec50e12751e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Converting VIF {"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG os_vif [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4c193bab-16, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4c193bab-16, col_values=(('external_ids', {'iface-id': '4c193bab-16ea-4313-bbdf-5c8a78f1543f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:4d:fe', 'vm-uuid': 'bbb086c5-5794-4855-ab1e-fec50e12751e'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:08 user nova-compute[72929]: INFO os_vif [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16')
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No VIF found with MAC fa:16:3e:9e:4d:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:29:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updated VIF entry in instance network info cache for port 4c193bab-16ea-4313-bbdf-5c8a78f1543f. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:29:09 user nova-compute[72929]: DEBUG nova.network.neutron [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updating instance_info_cache with network_info: [{"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-84d8dcb4-dc68-4f34-97fa-a0274ac89271 req-016953b8-c56e-4e3c-ab51-1d8124cac097 service nova] Releasing lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:29:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-f9a817e4-140a-4aa6-be92-b49b0072c293 req-c4a46b49-3e23-4134-803a-f2c2830f7c79 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f9a817e4-140a-4aa6-be92-b49b0072c293 req-c4a46b49-3e23-4134-803a-f2c2830f7c79 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f9a817e4-140a-4aa6-be92-b49b0072c293 req-c4a46b49-3e23-4134-803a-f2c2830f7c79 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-f9a817e4-140a-4aa6-be92-b49b0072c293 req-c4a46b49-3e23-4134-803a-f2c2830f7c79 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-f9a817e4-140a-4aa6-be92-b49b0072c293 req-c4a46b49-3e23-4134-803a-f2c2830f7c79 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:10 user nova-compute[72929]: WARNING nova.compute.manager [req-f9a817e4-140a-4aa6-be92-b49b0072c293 req-c4a46b49-3e23-4134-803a-f2c2830f7c79 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state building and task_state spawning.
Aug 26 22:29:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088952.104047, bbb086c5-5794-4855-ab1e-fec50e12751e => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] VM Resumed (Lifecycle Event)
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Instance spawned successfully.
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088952.1046872, bbb086c5-5794-4855-ab1e-fec50e12751e => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] VM Started (Lifecycle Event)
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-3ee36c3a-7667-4d14-b818-8654f6a1ab72 req-de622a40-1fad-499f-a055-858eb95ac6fb service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3ee36c3a-7667-4d14-b818-8654f6a1ab72 req-de622a40-1fad-499f-a055-858eb95ac6fb service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3ee36c3a-7667-4d14-b818-8654f6a1ab72 req-de622a40-1fad-499f-a055-858eb95ac6fb service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-3ee36c3a-7667-4d14-b818-8654f6a1ab72 req-de622a40-1fad-499f-a055-858eb95ac6fb service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-3ee36c3a-7667-4d14-b818-8654f6a1ab72 req-de622a40-1fad-499f-a055-858eb95ac6fb service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:12 user nova-compute[72929]: WARNING nova.compute.manager [req-3ee36c3a-7667-4d14-b818-8654f6a1ab72 req-de622a40-1fad-499f-a055-858eb95ac6fb service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state building and task_state spawning.
Aug 26 22:29:12 user nova-compute[72929]: INFO nova.compute.manager [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Took 6.44 seconds to build instance.
Aug 26 22:29:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-ef741f11-8d5e-482c-b4c5-773abe76cd7b tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.543s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:41 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "3cf6093e-f951-4b92-82ce-1631321dae07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:29:42 user nova-compute[72929]: INFO nova.compute.claims [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Claim successful on node user
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.357s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.network.neutron [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:29:42 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:29:42 user nova-compute[72929]: INFO nova.virt.block_device [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Booting with volume f845783e-a528-4e8a-8c71-854c428ef493 at /dev/vda
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.policy [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf31c30629f7485a9b160f8d853096dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6b106b16484bfa8fd629b57527130f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG os_brick.utils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ac07e-0137-45a4-b133-71ae9054e6ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c27e776-5292-48d9-80db-ccf20fed9684]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3c6c68-2aac-4a4d-9619-db57c2ee882f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[0039dff0-9244-42b4-b124-39eac07d5628]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:29:42 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:29:42 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc346f3-f68a-42c6-9e65-0e027834ca36]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG os_brick.utils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:29:42 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating existing volume attachment record: 555edddc-dd6d-4121-becd-3d808666a768 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG nova.network.neutron [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Successfully created port: e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [{"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:29:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Successfully updated port: e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquired lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-changed-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Refreshing instance network info cache due to event network-changed-e38037fc-9ab2-45c9-862a-ea173e58107a. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] Acquiring lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating instance_info_cache with network_info: [{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Releasing lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Instance network_info: |[{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] Acquired lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Refreshing network info cache for port e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-changed-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Refreshing instance network info cache due to event network-changed-286b78ad-c592-4a4c-91ff-291a7a1c1bf8. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] Acquiring lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] Acquired lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Refreshing network info cache for port 286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:44 user nova-compute[72929]: INFO nova.compute.manager [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Terminating instance
Aug 26 22:29:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.neutron [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updated VIF entry in instance network info cache for port e38037fc-9ab2-45c9-862a-ea173e58107a. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.neutron [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating instance_info_cache with network_info: [{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73d00267-5d60-4a8b-aebf-871391b5cbaa req-3b43b743-3858-4803-882c-59625bb89462 service nova] Releasing lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.neutron [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updated VIF entry in instance network info cache for port 286b78ad-c592-4a4c-91ff-291a7a1c1bf8. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.neutron [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating instance_info_cache with network_info: [{"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-789c25a9-26f2-4fa9-9136-4fc80f33f2e9 req-604e393e-d56e-404b-b319-cb84afbe72e9 service nova] Releasing lock "refresh_cache-5aee272f-0f8e-4933-bb08-0ec213add04b" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:29:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Instance destroyed successfully.
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.objects.instance [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'resources' on Instance uuid 5aee272f-0f8e-4933-bb08-0ec213add04b {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1351490129',display_name='tempest-TestStampPattern-server-1351490129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1351490129',id=48,image_ref='d1309c4c-0497-402d-889f-1bfd414eab69',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiaLbB2o5ogep87t7WRN4urPuEDh9KfODTmawEmQ/qu+koXzGTao7gJ3UDoNxVJWqJmt66x5jrC7LMSYWaF8J15hYRkFpmbiahmJyfRf5/bnTHh7hhMlqJUwHVXMCZF6g==',key_name='tempest-TestStampPattern-1421469942',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:26:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='302aa381f3904125a45c479568f7533c',ramdisk_id='',reservation_id='r-17ibkpdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8dd90429-8672-4c4f-b719-bb54921646f2',image_min_disk='1',image_min_ram='0',image_owner_id='302aa381f3904125a45c479568f7533c',image_owner_project_name='tempest-TestStampPattern-396757775',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-396757775-project-member',image_user_id='3c1250b5ba63437bb762df331fd6a80a',owner_project_name='tempest-TestStampPattern-396757775',owner_user_name='tempest-TestStampPattern-396757775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:26:53Z,user_data=None,user_id='3c1250b5ba63437bb762df331fd6a80a',uuid=5aee272f-0f8e-4933-bb08-0ec213add04b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converting VIF {"id": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "address": "fa:16:3e:c5:f6:bc", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap286b78ad-c5", "ovs_interfaceid": "286b78ad-c592-4a4c-91ff-291a7a1c1bf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG os_vif [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap286b78ad-c5, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:29:45 user nova-compute[72929]: INFO os_vif [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f6:bc,bridge_name='br-int',has_traffic_filtering=True,id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap286b78ad-c5')
Aug 26 22:29:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Deleting instance files /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b_del
Aug 26 22:29:45 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Deletion of /opt/stack/data/nova/instances/5aee272f-0f8e-4933-bb08-0ec213add04b_del complete
Aug 26 22:29:45 user nova-compute[72929]: INFO nova.compute.manager [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:45 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-b48efb5e-3dca-466c-8b25-75e3d08ed77f req-3f0a6ca6-34aa-4f70-a01e-8389e5f4b54a service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-vif-deleted-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:46 user nova-compute[72929]: INFO nova.compute.manager [req-b48efb5e-3dca-466c-8b25-75e3d08ed77f req-3f0a6ca6-34aa-4f70-a01e-8389e5f4b54a service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Neutron deleted interface 286b78ad-c592-4a4c-91ff-291a7a1c1bf8; detaching it from the instance and deleting it from the info cache
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.network.neutron [req-b48efb5e-3dca-466c-8b25-75e3d08ed77f req-3f0a6ca6-34aa-4f70-a01e-8389e5f4b54a service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:29:46 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Took 0.53 seconds to deallocate network for instance.
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-b48efb5e-3dca-466c-8b25-75e3d08ed77f req-3f0a6ca6-34aa-4f70-a01e-8389e5f4b54a service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Detach interface failed, port_id=286b78ad-c592-4a4c-91ff-291a7a1c1bf8, reason: Instance 5aee272f-0f8e-4933-bb08-0ec213add04b could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:46 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Deleted allocations for instance 5aee272f-0f8e-4933-bb08-0ec213add04b
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-vif-unplugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] No waiting events found dispatching network-vif-unplugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:46 user nova-compute[72929]: WARNING nova.compute.manager [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received unexpected event network-vif-unplugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 for instance with vm_state deleted and task_state None.
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received event network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] Acquiring lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] No waiting events found dispatching network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:46 user nova-compute[72929]: WARNING nova.compute.manager [req-75405ec3-cc05-48fb-9224-106eb1cb4603 req-488e0519-4818-4f97-bff7-1121e723cf06 service nova] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Received unexpected event network-vif-plugged-286b78ad-c592-4a4c-91ff-291a7a1c1bf8 for instance with vm_state deleted and task_state None.
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-895de0f0-30b5-44b3-8fd1-16b1b2754ec7 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "5aee272f-0f8e-4933-bb08-0ec213add04b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.011s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Error from libvirt while getting description of instance-00000030: [Error Code 42] Domain not found: no domain with matching uuid '5aee272f-0f8e-4933-bb08-0ec213add04b' (instance-00000030): libvirt.libvirtError: Domain not found: no domain with matching uuid '5aee272f-0f8e-4933-bb08-0ec213add04b' (instance-00000030)
Aug 26 22:29:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:29:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8097MB free_disk=23.655986785888672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b7993d49-af45-433e-8676-38ec3e12960f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bbb086c5-5794-4855-ab1e-fec50e12751e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3cf6093e-f951-4b92-82ce-1631321dae07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:29:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:29:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:29:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:29:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:29:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:29:53 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Creating image(s)
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf6093e-f951-4b92-82ce-1631321dae07/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Start _get_guest_xml network_info=[{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': '555edddc-dd6d-4121-becd-3d808666a768', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cf6093e-f951-4b92-82ce-1631321dae07', 'attached_at': '', 'detached_at': '', 'volume_id': 'f845783e-a528-4e8a-8c71-854c428ef493', 'serial': 'f845783e-a528-4e8a-8c71-854c428ef493'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:29:53 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:29:53 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:29:53 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:29:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:29:53 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:29:54 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:29:54 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c869fe-2dfe-4196-83c3-867cf4045aa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:29:54 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c910f9-6342-41b3-835b-21abd9619494]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493] added
Aug 26 22:29:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea65d1b-ac3e-46b2-96a1-f38d62929204]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56ba0d8-ffda-4c86-aea7-103b74233a4e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdQWPxoA {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bdQWPxoA" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f96c3-2c04-40d9-a04b-d3fa3e94fc12]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bdQWPxoA'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a14a11-48e1-47ad-a2b7-d9a2dc4fa7d8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f908c455-12e6-41fe-9712-0dd6e253d930]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:29:54 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:29:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:29:54 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:29:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64ad1e4-09cc-462f-b1a5-77e643578bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]
Aug 26 22:29:54 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.
Aug 26 22:29:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625d8ad-d71f-4b03-83a2-6eea64945b13]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[99098c94-ec90-4e5b-905a-5c5ed62a2b0c]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:29:54 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:29:54 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:29:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:29:54 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:29:54 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:29:54 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6e3661-89fa-41f4-be9f-45c52bbbac33]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:29:54 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23830643239323237', 'path': '/dev/sdb'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830643239323237', 'path': '/dev/sdb'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-884145443',display_name='tempest-TestVolumeBootPattern-server-884145443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-884145443',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-tc9h97li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:29:43Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=3cf6093e-f951-4b92-82ce-1631321dae07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.objects.instance [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf6093e-f951-4b92-82ce-1631321dae07 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:29:55 user nova-compute[72929]:   <uuid>3cf6093e-f951-4b92-82ce-1631321dae07</uuid>
Aug 26 22:29:55 user nova-compute[72929]:   <name>instance-00000033</name>
Aug 26 22:29:55 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:29:55 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:29:55 user nova-compute[72929]:   <metadata>
Aug 26 22:29:55 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:29:55 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:29:55 user nova-compute[72929]:       <nova:name>tempest-TestVolumeBootPattern-server-884145443</nova:name>
Aug 26 22:29:55 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:29:53</nova:creationTime>
Aug 26 22:29:55 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:29:55 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:29:55 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:29:55 user nova-compute[72929]:       <nova:owner>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:user uuid="cf31c30629f7485a9b160f8d853096dc">tempest-TestVolumeBootPattern-1716061349-project-member</nova:user>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:project uuid="ea6b106b16484bfa8fd629b57527130f">tempest-TestVolumeBootPattern-1716061349</nova:project>
Aug 26 22:29:55 user nova-compute[72929]:       </nova:owner>
Aug 26 22:29:55 user nova-compute[72929]:       <nova:ports>
Aug 26 22:29:55 user nova-compute[72929]:         <nova:port uuid="e38037fc-9ab2-45c9-862a-ea173e58107a">
Aug 26 22:29:55 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 26 22:29:55 user nova-compute[72929]:         </nova:port>
Aug 26 22:29:55 user nova-compute[72929]:       </nova:ports>
Aug 26 22:29:55 user nova-compute[72929]:     </nova:instance>
Aug 26 22:29:55 user nova-compute[72929]:   </metadata>
Aug 26 22:29:55 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:29:55 user nova-compute[72929]:     <system>
Aug 26 22:29:55 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:29:55 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:29:55 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:29:55 user nova-compute[72929]:       <entry name="serial">3cf6093e-f951-4b92-82ce-1631321dae07</entry>
Aug 26 22:29:55 user nova-compute[72929]:       <entry name="uuid">3cf6093e-f951-4b92-82ce-1631321dae07</entry>
Aug 26 22:29:55 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:29:55 user nova-compute[72929]:     </system>
Aug 26 22:29:55 user nova-compute[72929]:   </sysinfo>
Aug 26 22:29:55 user nova-compute[72929]:   <os>
Aug 26 22:29:55 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:29:55 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:29:55 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:29:55 user nova-compute[72929]:   </os>
Aug 26 22:29:55 user nova-compute[72929]:   <features>
Aug 26 22:29:55 user nova-compute[72929]:     <acpi/>
Aug 26 22:29:55 user nova-compute[72929]:     <apic/>
Aug 26 22:29:55 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:29:55 user nova-compute[72929]:   </features>
Aug 26 22:29:55 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:29:55 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:29:55 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:29:55 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:29:55 user nova-compute[72929]:   </clock>
Aug 26 22:29:55 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:29:55 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:29:55 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:29:55 user nova-compute[72929]:   </cpu>
Aug 26 22:29:55 user nova-compute[72929]:   <devices>
Aug 26 22:29:55 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:29:55 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:29:55 user nova-compute[72929]:       <source dev="/dev/sdb"/>
Aug 26 22:29:55 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:29:55 user nova-compute[72929]:       <serial>f845783e-a528-4e8a-8c71-854c428ef493</serial>
Aug 26 22:29:55 user nova-compute[72929]:     </disk>
Aug 26 22:29:55 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:29:55 user nova-compute[72929]:       <mac address="fa:16:3e:b5:a8:83"/>
Aug 26 22:29:55 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:29:55 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:29:55 user nova-compute[72929]:       <target dev="tape38037fc-9a"/>
Aug 26 22:29:55 user nova-compute[72929]:     </interface>
Aug 26 22:29:55 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:29:55 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/3cf6093e-f951-4b92-82ce-1631321dae07/console.log" append="off"/>
Aug 26 22:29:55 user nova-compute[72929]:     </serial>
Aug 26 22:29:55 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:29:55 user nova-compute[72929]:     <video>
Aug 26 22:29:55 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:29:55 user nova-compute[72929]:     </video>
Aug 26 22:29:55 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:29:55 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:29:55 user nova-compute[72929]:     </rng>
Aug 26 22:29:55 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:29:55 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:29:55 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:29:55 user nova-compute[72929]:     </memballoon>
Aug 26 22:29:55 user nova-compute[72929]:   </devices>
Aug 26 22:29:55 user nova-compute[72929]: </domain>
Aug 26 22:29:55 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-884145443',display_name='tempest-TestVolumeBootPattern-server-884145443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-884145443',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-tc9h97li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:29:43Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=3cf6093e-f951-4b92-82ce-1631321dae07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG os_vif [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape38037fc-9a, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape38037fc-9a, col_values=(('external_ids', {'iface-id': 'e38037fc-9ab2-45c9-862a-ea173e58107a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:a8:83', 'vm-uuid': '3cf6093e-f951-4b92-82ce-1631321dae07'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:55 user nova-compute[72929]: INFO os_vif [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a')
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:29:55 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No VIF found with MAC fa:16:3e:b5:a8:83, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:29:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:56 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-fd3ea016-6c76-484b-9307-70304eac7453 req-328e1b39-0677-4391-b415-2c71fc10f4b8 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fd3ea016-6c76-484b-9307-70304eac7453 req-328e1b39-0677-4391-b415-2c71fc10f4b8 service nova] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fd3ea016-6c76-484b-9307-70304eac7453 req-328e1b39-0677-4391-b415-2c71fc10f4b8 service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fd3ea016-6c76-484b-9307-70304eac7453 req-328e1b39-0677-4391-b415-2c71fc10f4b8 service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-fd3ea016-6c76-484b-9307-70304eac7453 req-328e1b39-0677-4391-b415-2c71fc10f4b8 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] No waiting events found dispatching network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:57 user nova-compute[72929]: WARNING nova.compute.manager [req-fd3ea016-6c76-484b-9307-70304eac7453 req-328e1b39-0677-4391-b415-2c71fc10f4b8 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received unexpected event network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a for instance with vm_state building and task_state spawning.
Aug 26 22:29:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:57 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088998.71014, 3cf6093e-f951-4b92-82ce-1631321dae07 => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] VM Resumed (Lifecycle Event)
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Instance spawned successfully.
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693088998.71186, 3cf6093e-f951-4b92-82ce-1631321dae07 => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] VM Started (Lifecycle Event)
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 26 22:29:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:29:58 user nova-compute[72929]: INFO nova.compute.manager [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Took 16.76 seconds to build instance.
Aug 26 22:29:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-09f22a9c-5002-4995-b73f-69bcc0e7b6e0 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "3cf6093e-f951-4b92-82ce-1631321dae07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.869s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:29:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf9a8203-1cf0-4eb5-be5d-1dafc0e1a700 req-e91ec8c9-35ad-493e-a5ab-59d2fef26520 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:29:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf9a8203-1cf0-4eb5-be5d-1dafc0e1a700 req-e91ec8c9-35ad-493e-a5ab-59d2fef26520 service nova] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:29:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf9a8203-1cf0-4eb5-be5d-1dafc0e1a700 req-e91ec8c9-35ad-493e-a5ab-59d2fef26520 service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:29:59 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-bf9a8203-1cf0-4eb5-be5d-1dafc0e1a700 req-e91ec8c9-35ad-493e-a5ab-59d2fef26520 service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:29:59 user nova-compute[72929]: DEBUG nova.compute.manager [req-bf9a8203-1cf0-4eb5-be5d-1dafc0e1a700 req-e91ec8c9-35ad-493e-a5ab-59d2fef26520 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] No waiting events found dispatching network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:29:59 user nova-compute[72929]: WARNING nova.compute.manager [req-bf9a8203-1cf0-4eb5-be5d-1dafc0e1a700 req-e91ec8c9-35ad-493e-a5ab-59d2fef26520 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received unexpected event network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a for instance with vm_state active and task_state None.
Aug 26 22:30:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:00 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693088985.601542, 5aee272f-0f8e-4933-bb08-0ec213add04b => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:30:00 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] VM Stopped (Lifecycle Event)
Aug 26 22:30:00 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2989efa8-beb0-4765-aa10-c93294c375da None None] [instance: 5aee272f-0f8e-4933-bb08-0ec213add04b] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:30:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:30:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:30:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:30:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:30:42 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updating instance_info_cache with network_info: [{"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-83ba3bb1-8898-4e12-ac70-84c2c028dbcc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "b7993d49-af45-433e-8676-38ec3e12960f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:43 user nova-compute[72929]: INFO nova.compute.manager [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Terminating instance
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-73926b4e-71d9-447c-bbab-1fd3d2bb03a4 req-ef8d295a-6f04-4a34-b120-f830073ef0ff service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73926b4e-71d9-447c-bbab-1fd3d2bb03a4 req-ef8d295a-6f04-4a34-b120-f830073ef0ff service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73926b4e-71d9-447c-bbab-1fd3d2bb03a4 req-ef8d295a-6f04-4a34-b120-f830073ef0ff service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-73926b4e-71d9-447c-bbab-1fd3d2bb03a4 req-ef8d295a-6f04-4a34-b120-f830073ef0ff service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-73926b4e-71d9-447c-bbab-1fd3d2bb03a4 req-ef8d295a-6f04-4a34-b120-f830073ef0ff service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG nova.compute.manager [req-73926b4e-71d9-447c-bbab-1fd3d2bb03a4 req-ef8d295a-6f04-4a34-b120-f830073ef0ff service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-unplugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Instance destroyed successfully.
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.objects.instance [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'resources' on Instance uuid b7993d49-af45-433e-8676-38ec3e12960f {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-196411701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-196411701',id=47,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-k3f5mxv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:28:58Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=b7993d49-af45-433e-8676-38ec3e12960f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "address": "fa:16:3e:de:e9:9c", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d101a1a-3d", "ovs_interfaceid": "9d101a1a-3dc1-493f-bbb9-649aabca0df7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_vif [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d101a1a-3d, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:30:44 user nova-compute[72929]: INFO os_vif [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:e9:9c,bridge_name='br-int',has_traffic_filtering=True,id=9d101a1a-3dc1-493f-bbb9-649aabca0df7,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d101a1a-3d')
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjskGSbQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:30:44 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7afb4d7-cc90-4f84-b8ee-22d8e52f8117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cd42e6-fd44-4fe0-ac54-905bbeb99fa1]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:30:44 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:30:44 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:30:44 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:30:44 user nova-compute[72929]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 (non-flash)
Aug 26 22:30:44 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:30:44 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8018a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6'): ({'sdf'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Removing single pathed devices sdf {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3e21c9-3ccb-4ab7-9d60-d29829717b79]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f428b-6da5-4a78-bc35-a16e6c8da57a]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flushing IO for device /dev/sdf {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4541e9-32dd-404f-b48a-a89a5da93ed6]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b6dd6-3439-466c-9e11-6f9b7e2947c2]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] SCSI volumes sdf have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7cede51d-fd371f47252743b9', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7cede51d', '/dev/disk/by-id/scsi-26664333731663437') {{(pid=84150) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[772ce696-d5ef-42f7-8d24-cc9e0015e23e]: (4, None) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6515db0-d26e-4ce8-ad61-9f34d1b9085e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff14f50f-2b6e-4ede-8e86-f18e1b176ac7]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260]
Aug 26 22:30:44 user nova-compute[72929]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6, portal: 172.16.0.220,3260] successful.
Aug 26 22:30:44 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffba64a1-49e9-4eb3-84a4-f56b6d40efa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5378caac-5392-48f0-98e8-0453a68b09f2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== disconnect_volume: return (326ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:30:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Deleting instance files /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f_del
Aug 26 22:30:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Deletion of /opt/stack/data/nova/instances/b7993d49-af45-433e-8676-38ec3e12960f_del complete
Aug 26 22:30:44 user nova-compute[72929]: INFO nova.compute.manager [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 26 22:30:44 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:30:44 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-0b944c08-aba9-42a2-bc84-449dddb7c9ca req-dae1aad8-329c-495c-baa8-48c27df79707 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-deleted-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:45 user nova-compute[72929]: INFO nova.compute.manager [req-0b944c08-aba9-42a2-bc84-449dddb7c9ca req-dae1aad8-329c-495c-baa8-48c27df79707 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Neutron deleted interface 9d101a1a-3dc1-493f-bbb9-649aabca0df7; detaching it from the instance and deleting it from the info cache
Aug 26 22:30:45 user nova-compute[72929]: DEBUG nova.network.neutron [req-0b944c08-aba9-42a2-bc84-449dddb7c9ca req-dae1aad8-329c-495c-baa8-48c27df79707 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:30:45 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Took 0.46 seconds to deallocate network for instance.
Aug 26 22:30:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-0b944c08-aba9-42a2-bc84-449dddb7c9ca req-dae1aad8-329c-495c-baa8-48c27df79707 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Detach interface failed, port_id=9d101a1a-3dc1-493f-bbb9-649aabca0df7, reason: Instance b7993d49-af45-433e-8676-38ec3e12960f could not be found. {{(pid=72929) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-41a7986f-2641-4944-a7db-5f02c4057a3a req-2d7c3270-8c46-4c1d-b758-c8e17aa96db6 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-41a7986f-2641-4944-a7db-5f02c4057a3a req-2d7c3270-8c46-4c1d-b758-c8e17aa96db6 service nova] Acquiring lock "b7993d49-af45-433e-8676-38ec3e12960f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-41a7986f-2641-4944-a7db-5f02c4057a3a req-2d7c3270-8c46-4c1d-b758-c8e17aa96db6 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-41a7986f-2641-4944-a7db-5f02c4057a3a req-2d7c3270-8c46-4c1d-b758-c8e17aa96db6 service nova] Lock "b7993d49-af45-433e-8676-38ec3e12960f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:45 user nova-compute[72929]: DEBUG nova.compute.manager [req-41a7986f-2641-4944-a7db-5f02c4057a3a req-2d7c3270-8c46-4c1d-b758-c8e17aa96db6 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] No waiting events found dispatching network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:30:45 user nova-compute[72929]: WARNING nova.compute.manager [req-41a7986f-2641-4944-a7db-5f02c4057a3a req-2d7c3270-8c46-4c1d-b758-c8e17aa96db6 service nova] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Received unexpected event network-vif-plugged-9d101a1a-3dc1-493f-bbb9-649aabca0df7 for instance with vm_state active and task_state deleting.
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:30:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:48 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:30:48 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8166MB free_disk=23.74529266357422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 8dd90429-8672-4c4f-b719-bb54921646f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance b7993d49-af45-433e-8676-38ec3e12960f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bbb086c5-5794-4855-ab1e-fec50e12751e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3cf6093e-f951-4b92-82ce-1631321dae07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:30:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:48 user nova-compute[72929]: INFO nova.compute.manager [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Took 3.71 seconds to detach 1 volumes for instance.
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-changed-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Refreshing instance network info cache due to event network-changed-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] Acquiring lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] Acquired lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Refreshing network info cache for port cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:49 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Deleted allocations for instance b7993d49-af45-433e-8676-38ec3e12960f
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:49 user nova-compute[72929]: INFO nova.compute.manager [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Terminating instance
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.compute.manager [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-126568f5-2fd0-438e-bd61-1653fc8baea7 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "b7993d49-af45-433e-8676-38ec3e12960f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.817s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updated VIF entry in instance network info cache for port cf6f6be2-e9c2-4e1f-8379-8bff3e253de3. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating instance_info_cache with network_info: [{"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cb858f01-bfab-4312-a325-406d75ea1488 req-5db55e44-5809-4c05-85ad-056d434f37db service nova] Releasing lock "refresh_cache-8dd90429-8672-4c4f-b719-bb54921646f2" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:30:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Instance destroyed successfully.
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.objects.instance [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lazy-loading 'resources' on Instance uuid 8dd90429-8672-4c4f-b719-bb54921646f2 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:23:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-921785682',display_name='tempest-TestStampPattern-server-921785682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-921785682',id=45,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiaLbB2o5ogep87t7WRN4urPuEDh9KfODTmawEmQ/qu+koXzGTao7gJ3UDoNxVJWqJmt66x5jrC7LMSYWaF8J15hYRkFpmbiahmJyfRf5/bnTHh7hhMlqJUwHVXMCZF6g==',key_name='tempest-TestStampPattern-1421469942',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:23:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='302aa381f3904125a45c479568f7533c',ramdisk_id='',reservation_id='r-ud008q26',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-396757775',owner_user_name='tempest-TestStampPattern-396757775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:26:43Z,user_data=None,user_id='3c1250b5ba63437bb762df331fd6a80a',uuid=8dd90429-8672-4c4f-b719-bb54921646f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converting VIF {"id": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "address": "fa:16:3e:3e:52:e3", "network": {"id": "521349d2-8359-43df-a931-d9e4c7f6a359", "bridge": "br-int", "label": "tempest-TestStampPattern-1912059417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "302aa381f3904125a45c479568f7533c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6f6be2-e9", "ovs_interfaceid": "cf6f6be2-e9c2-4e1f-8379-8bff3e253de3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG os_vif [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf6f6be2-e9, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:30:50 user nova-compute[72929]: INFO os_vif [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:52:e3,bridge_name='br-int',has_traffic_filtering=True,id=cf6f6be2-e9c2-4e1f-8379-8bff3e253de3,network=Network(521349d2-8359-43df-a931-d9e4c7f6a359),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6f6be2-e9')
Aug 26 22:30:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Deleting instance files /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2_del
Aug 26 22:30:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Deletion of /opt/stack/data/nova/instances/8dd90429-8672-4c4f-b719-bb54921646f2_del complete
Aug 26 22:30:50 user nova-compute[72929]: INFO nova.compute.manager [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 22:30:50 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:30:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:30:50 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Took 0.76 seconds to deallocate network for instance.
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:51 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Deleted allocations for instance 8dd90429-8672-4c4f-b719-bb54921646f2
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-vif-unplugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] No waiting events found dispatching network-vif-unplugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:30:51 user nova-compute[72929]: WARNING nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received unexpected event network-vif-unplugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 for instance with vm_state deleted and task_state None.
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] Acquiring lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] Lock "8dd90429-8672-4c4f-b719-bb54921646f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] No waiting events found dispatching network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:30:51 user nova-compute[72929]: WARNING nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received unexpected event network-vif-plugged-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 for instance with vm_state deleted and task_state None.
Aug 26 22:30:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-36927a00-888b-46e0-9493-6118ecef948f req-5fa34b6f-f04f-4af2-81af-49f9b59fbc9e service nova] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Received event network-vif-deleted-cf6f6be2-e9c2-4e1f-8379-8bff3e253de3 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-7399456b-13cf-40d0-89e9-86744c43e0a3 tempest-TestStampPattern-396757775 tempest-TestStampPattern-396757775-project-member] Lock "8dd90429-8672-4c4f-b719-bb54921646f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.974s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:53 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:30:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-changed-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG nova.compute.manager [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Refreshing instance network info cache due to event network-changed-4c193bab-16ea-4313-bbdf-5c8a78f1543f. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] Acquiring lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] Acquired lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Refreshing network info cache for port 4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updated VIF entry in instance network info cache for port 4c193bab-16ea-4313-bbdf-5c8a78f1543f. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG nova.network.neutron [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updating instance_info_cache with network_info: [{"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-c0235553-676a-439b-bbc7-1c0d3e3d62e2 req-8940b70b-a248-43c3-8b26-6da7d5fd6881 service nova] Releasing lock "refresh_cache-bbb086c5-5794-4855-ab1e-fec50e12751e" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:57 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG nova.objects.instance [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'flavor' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:30:58 user nova-compute[72929]: INFO nova.compute.manager [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attaching volume b945b3e8-1dc8-41ea-afa5-ef3899e396cf to /dev/vdb
Aug 26 22:30:58 user nova-compute[72929]: DEBUG os_brick.utils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be2748b-e99f-4024-abad-ea62fd08a9eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3dca57-1c3d-4aff-975b-718f653b4178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb9cada-c12b-47e0-8c9f-8a2ae9ede158]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3836a968-da9f-4810-b766-ce45d481e91f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:30:58 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:30:58 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0d4fa-40c0-4d73-8ad9-55b14a852eb9]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG os_brick.utils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:30:58 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updating existing volume attachment record: 673e4d7b-9eb9-4f51-9866-2649d71c07d8 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:30:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:30:59 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089044.3726387, b7993d49-af45-433e-8676-38ec3e12960f => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:30:59 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: b7993d49-af45-433e-8676-38ec3e12960f] VM Stopped (Lifecycle Event)
Aug 26 22:30:59 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9b3b8516-9f53-4570-976c-3361dd60bdc7 None None] [instance: b7993d49-af45-433e-8676-38ec3e12960f] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:31:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:05 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089050.0966055, 8dd90429-8672-4c4f-b719-bb54921646f2 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:31:05 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] VM Stopped (Lifecycle Event)
Aug 26 22:31:05 user nova-compute[72929]: DEBUG nova.compute.manager [None req-1a2e75f0-a107-4243-a5c3-a9fad7562618 None None] [instance: 8dd90429-8672-4c4f-b719-bb54921646f2] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:31:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAiPyBlr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:31:09 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:31:09 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:31:09 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[215df2ae-1f85-49e9-8235-7f20ef2de536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:31:09 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4217e8-411e-4878-a8df-a2d43cfa3c43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf] added
Aug 26 22:31:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ec834-1984-4dd6-961f-8368ef03c33e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d4b21-a55c-4a24-80ed-62549d2d9e32]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAiPyBlr {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAiPyBlr" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ace173-57fe-45f7-82c6-66cfab26dc11]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAiPyBlr'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf68e01a-4c2a-476c-a9a6-3dc5e2b89c04]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fbff3b-9e67-429b-abff-4dd5c06ac12e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:09 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:09 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae24c2b-33ca-4fd4-8de7-8409f7d99fde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260]
Aug 26 22:31:09 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260] successful.
Aug 26 22:31:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6f6a04-237e-4eb0-a061-dfb057efe69d]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b493fff-88e3-4c8e-b1b6-f562c7d1b5b3]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:09 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:09 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:09 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:09 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:09 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1078e1b2-e586-4244-b1a7-93cfc6bb833d]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:09 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAiPyBlr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26266663737353531', 'path': '/dev/sdc'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266663737353531', 'path': '/dev/sdc'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'flavor' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:31:10 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:31:10 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:31:10 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:31:10 user nova-compute[72929]:   <serial>b945b3e8-1dc8-41ea-afa5-ef3899e396cf</serial>
Aug 26 22:31:10 user nova-compute[72929]: </disk>
Aug 26 22:31:10 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:31:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No VIF found with MAC fa:16:3e:9e:4d:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:31:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-078d7c80-909e-4038-88db-327faf799c20 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.844s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG nova.objects.instance [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'flavor' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:14 user nova-compute[72929]: INFO nova.compute.manager [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attaching volume 91c11578-da8a-400c-8cc4-646587e6f51e to /dev/vdc
Aug 26 22:31:14 user nova-compute[72929]: DEBUG os_brick.utils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01bc824-5a74-41a4-b24e-0189231676bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b536398d-1bac-4794-a6f0-057b68ae95f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4fcbb5-051f-4905-b77a-3307c896bad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca72752d-adff-4d9c-87e1-3378d889b7cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:31:14 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:31:14 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e8a73-3ead-428d-8432-23b170d186ac]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG os_brick.utils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:31:14 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updating existing volume attachment record: 01d9883f-f467-4ed0-a162-f4a66d42d268 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:31:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaRizvpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:31:25 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:31:25 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:31:25 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[46105dd5-bf6a-47f2-97b1-39ed4c145df5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:31:25 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f740d012-ecd7-477d-9ea8-54cc99ec0519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e] added
Aug 26 22:31:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5f4829-495d-47b8-a818-b71f9fa9b147]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c207d366-5483-4933-a3ec-fb62982592c0]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uaRizvpV {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uaRizvpV" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cf56e8-c817-4ad1-9a0e-c566fcf4cb11]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uaRizvpV'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[600faf8f-de49-4eb5-8b3c-35379c1b5ff2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b1bb0f-95bd-4425-b29a-7431b384ea5e]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:25 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:25 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:25 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:25 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:31:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c217339-d4ce-472a-bfc7-1bcfead8f97e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260]
Aug 26 22:31:26 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260] successful.
Aug 26 22:31:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bb93d6-3092-4907-a215-42fe26943c94]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dded23a-724d-487d-9539-b15f98e6dc54]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:26 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:26 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:26 user nova-compute[72929]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e (non-flash)
Aug 26 22:31:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:26 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:26 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:26 user nova-compute[72929]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e (non-flash)
Aug 26 22:31:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] HCTL ('36', '-', '-', 0) found on session 59 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec382eb7-d31e-42b4-814e-bb89ef8a8fd0]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Searching for a device in session 59 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:31:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaRizvpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26538363563316665', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538363563316665', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.objects.instance [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'flavor' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] attach device xml: <disk type="block" device="disk">
Aug 26 22:31:27 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:31:27 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:31:27 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:31:27 user nova-compute[72929]:   <serial>91c11578-da8a-400c-8cc4-646587e6f51e</serial>
Aug 26 22:31:27 user nova-compute[72929]: </disk>
Aug 26 22:31:27 user nova-compute[72929]:  {{(pid=72929) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] No VIF found with MAC fa:16:3e:9e:4d:fe, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:31:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-dbd534a0-7214-453b-b7c4-aa7c3c09963a tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.208s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:28 user nova-compute[72929]: INFO nova.compute.manager [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Detaching volume 91c11578-da8a-400c-8cc4-646587e6f51e
Aug 26 22:31:28 user nova-compute[72929]: INFO nova.virt.block_device [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attempting to driver detach volume 91c11578-da8a-400c-8cc4-646587e6f51e from mountpoint /dev/vdc
Aug 26 22:31:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Attempting to detach device vdc from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:31:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:31:28 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:31:28 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:31:28 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:31:28 user nova-compute[72929]:   <serial>91c11578-da8a-400c-8cc4-646587e6f51e</serial>
Aug 26 22:31:28 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 22:31:28 user nova-compute[72929]: </disk>
Aug 26 22:31:28 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:31:28 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Successfully detached device vdc from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the persistent domain config.
Aug 26 22:31:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:31:28 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:31:28 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:31:28 user nova-compute[72929]:   <source dev="/dev/sde"/>
Aug 26 22:31:28 user nova-compute[72929]:   <target dev="vdc" bus="virtio"/>
Aug 26 22:31:28 user nova-compute[72929]:   <serial>91c11578-da8a-400c-8cc4-646587e6f51e</serial>
Aug 26 22:31:28 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 26 22:31:28 user nova-compute[72929]: </disk>
Aug 26 22:31:28 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693089089.2705808, bbb086c5-5794-4855-ab1e-fec50e12751e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:31:29 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Successfully detached device vdc from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the live domain config.
Aug 26 22:31:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uaRizvpV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:31:29 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[215e5938-5195-40cd-be03-243e69301798]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd568346-6de2-4a41-a057-b08c430fed63]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:29 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:29 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:29 user nova-compute[72929]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e (non-flash)
Aug 26 22:31:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:31:29 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:31:29 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:31:29 user nova-compute[72929]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e (non-flash)
Aug 26 22:31:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b803bef80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c79a7b8-b55d-436e-a137-b16ec5428fa5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94dfe6e-3067-4fad-ab54-bf1b52e80426]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffabe0a5-4b73-4084-a936-13db8981c88e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7f83c9-9d9b-4967-b10f-bf98da33c3fb]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e957c4-cd74-45e7-9f45-9a1f52dd6747]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6a4d31-a4a5-42a3-b888-c52ddc0d407f]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260]
Aug 26 22:31:29 user nova-compute[72929]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e, portal: 172.16.0.220,3260] successful.
Aug 26 22:31:29 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91c11578-da8a-400c-8cc4-646587e6f51e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fecde4f-df6a-40a0-86bf-b0943a705d7a]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] <== disconnect_volume: return (277ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:31:29 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:31:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:30 user nova-compute[72929]: DEBUG nova.objects.instance [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'flavor' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:31:30 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-116b6c7a-3f8d-47ae-8e1c-7633eaed3d89 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.658s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:32 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-changed-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:31:33 user nova-compute[72929]: DEBUG nova.compute.manager [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Refreshing instance network info cache due to event network-changed-e38037fc-9ab2-45c9-862a-ea173e58107a. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:31:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] Acquiring lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:31:33 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] Acquired lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:31:33 user nova-compute[72929]: DEBUG nova.network.neutron [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Refreshing network info cache for port e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updated VIF entry in instance network info cache for port e38037fc-9ab2-45c9-862a-ea173e58107a. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG nova.network.neutron [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating instance_info_cache with network_info: [{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-614905c7-9f82-4bb0-8c83-42769ea0c0e3 req-3174640b-53c1-4e40-ada6-a57b9e026679 service nova] Releasing lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:34 user nova-compute[72929]: INFO nova.compute.manager [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Terminating instance
Aug 26 22:31:34 user nova-compute[72929]: DEBUG nova.compute.manager [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-cc6177eb-451a-4939-9b87-be1ad573f447 req-0884e082-e148-449f-b47a-69d78ad1adfd service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-vif-unplugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cc6177eb-451a-4939-9b87-be1ad573f447 req-0884e082-e148-449f-b47a-69d78ad1adfd service nova] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cc6177eb-451a-4939-9b87-be1ad573f447 req-0884e082-e148-449f-b47a-69d78ad1adfd service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-cc6177eb-451a-4939-9b87-be1ad573f447 req-0884e082-e148-449f-b47a-69d78ad1adfd service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-cc6177eb-451a-4939-9b87-be1ad573f447 req-0884e082-e148-449f-b47a-69d78ad1adfd service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] No waiting events found dispatching network-vif-unplugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:31:34 user nova-compute[72929]: DEBUG nova.compute.manager [req-cc6177eb-451a-4939-9b87-be1ad573f447 req-0884e082-e148-449f-b47a-69d78ad1adfd service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-vif-unplugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Instance destroyed successfully.
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.objects.instance [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'resources' on Instance uuid 83ba3bb1-8898-4e12-ac70-84c2c028dbcc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:22:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1683106429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1683106429',id=41,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:22:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-n1sn4zsf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:24:08Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=83ba3bb1-8898-4e12-ac70-84c2c028dbcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "address": "fa:16:3e:f2:5d:0e", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f7fc57e-2e", "ovs_interfaceid": "3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG os_vif [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f7fc57e-2e, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:31:35 user nova-compute[72929]: INFO os_vif [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:5d:0e,bridge_name='br-int',has_traffic_filtering=True,id=3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f7fc57e-2e')
Aug 26 22:31:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Deleting instance files /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc_del
Aug 26 22:31:35 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Deletion of /opt/stack/data/nova/instances/83ba3bb1-8898-4e12-ac70-84c2c028dbcc_del complete
Aug 26 22:31:35 user nova-compute[72929]: INFO nova.compute.manager [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 26 22:31:35 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:31:35 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Took 0.65 seconds to deallocate network for instance.
Aug 26 22:31:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:35 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-1d1e65bd-4aa8-4b17-8fae-198b6d63c4ea req-0d8f42fc-d910-4f04-9b00-2038587352e6 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-vif-deleted-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:36 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Deleted allocations for instance 83ba3bb1-8898-4e12-ac70-84c2c028dbcc
Aug 26 22:31:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-9a923e18-d821-4ec0-afa1-f0f47e9e8dfb tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-969ff7c3-ed93-41f6-b938-4b3c88bfd7b7 req-aa8146aa-af48-44b4-a529-8cc6edc06227 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received event network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-969ff7c3-ed93-41f6-b938-4b3c88bfd7b7 req-aa8146aa-af48-44b4-a529-8cc6edc06227 service nova] Acquiring lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-969ff7c3-ed93-41f6-b938-4b3c88bfd7b7 req-aa8146aa-af48-44b4-a529-8cc6edc06227 service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-969ff7c3-ed93-41f6-b938-4b3c88bfd7b7 req-aa8146aa-af48-44b4-a529-8cc6edc06227 service nova] Lock "83ba3bb1-8898-4e12-ac70-84c2c028dbcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:36 user nova-compute[72929]: DEBUG nova.compute.manager [req-969ff7c3-ed93-41f6-b938-4b3c88bfd7b7 req-aa8146aa-af48-44b4-a529-8cc6edc06227 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] No waiting events found dispatching network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:31:36 user nova-compute[72929]: WARNING nova.compute.manager [req-969ff7c3-ed93-41f6-b938-4b3c88bfd7b7 req-aa8146aa-af48-44b4-a529-8cc6edc06227 service nova] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Received unexpected event network-vif-plugged-3f7fc57e-2ec5-49a1-a4cd-e4e2cee0d4a2 for instance with vm_state deleted and task_state None.
Aug 26 22:31:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:31:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:31:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:31:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:45 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:31:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:31:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8434MB free_disk=23.89623260498047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bbb086c5-5794-4855-ab1e-fec50e12751e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3cf6093e-f951-4b92-82ce-1631321dae07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:31:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:31:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:31:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089095.157329, 83ba3bb1-8898-4e12-ac70-84c2c028dbcc => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:31:50 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] VM Stopped (Lifecycle Event)
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-604b16a4-53b5-40cf-b6e7-8190b0aae08d None None] [instance: 83ba3bb1-8898-4e12-ac70-84c2c028dbcc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Starting instance... {{(pid=72929) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72929) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 26 22:31:50 user nova-compute[72929]: INFO nova.compute.claims [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Claim successful on node user
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Start building networks asynchronously for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Allocating IP information in the background. {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.network.neutron [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] allocate_for_instance() {{(pid=72929) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 26 22:31:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Start building block device mappings for instance. {{(pid=72929) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 26 22:31:50 user nova-compute[72929]: INFO nova.virt.block_device [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Booting with volume edf45021-7344-46e1-80dc-35b2e074b49f at /dev/vda
Aug 26 22:31:50 user nova-compute[72929]: DEBUG nova.policy [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf31c30629f7485a9b160f8d853096dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea6b106b16484bfa8fd629b57527130f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72929) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG os_brick.utils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[410ba9b7-584c-402f-8d2c-5bb5c64b67bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:7a8cdf20219d\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab65d9e6-9dd7-4890-9fcf-6b94ff251c77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a1848-8aa2-47ed-81d5-fed67cdd01fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[32853581-3bca-471f-bf22-6d87271ea719]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Running cmd (subprocess): nvme version {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] 'nvme version' failed. Not Retrying. {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] nvme not present on system {{(pid=72929) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 26 22:31:50 user nova-compute[72929]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 26 22:31:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c72c0-32ce-4f43-8081-81a4873d08af]: (4, '') {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72929) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.lightos [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] LIGHTOS: no hostnqn found. {{(pid=72929) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 26 22:31:50 user nova-compute[72929]: DEBUG os_brick.utils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:7a8cdf20219d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:31:51 user nova-compute[72929]: DEBUG nova.virt.block_device [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updating existing volume attachment record: beb86fd6-f0d0-4504-8ae4-dde815ed81b1 {{(pid=72929) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 26 22:31:51 user nova-compute[72929]: DEBUG nova.network.neutron [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Successfully created port: 34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Successfully updated port: 34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquired lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Building network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-changed-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG nova.compute.manager [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Refreshing instance network info cache due to event network-changed-34737c17-0cbb-4c88-b17e-24c6826b6e71. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] Acquiring lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:31:52 user nova-compute[72929]: DEBUG nova.network.neutron [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Instance cache missing network info. {{(pid=72929) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 26 22:31:53 user nova-compute[72929]: DEBUG nova.network.neutron [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updating instance_info_cache with network_info: [{"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:31:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Releasing lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:31:53 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Instance network_info: |[{"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72929) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 26 22:31:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] Acquired lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:31:53 user nova-compute[72929]: DEBUG nova.network.neutron [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Refreshing network info cache for port 34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:31:54 user nova-compute[72929]: DEBUG nova.network.neutron [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updated VIF entry in instance network info cache for port 34737c17-0cbb-4c88-b17e-24c6826b6e71. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:31:54 user nova-compute[72929]: DEBUG nova.network.neutron [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updating instance_info_cache with network_info: [{"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:31:54 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-fbf6fd94-37b3-4671-98d8-3663204703b3 req-f4ffb4d0-1106-44d0-a9f0-fd17cbe0a448 service nova] Releasing lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:31:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:31:55 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:31:55 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:32:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Start spawning the instance on the hypervisor. {{(pid=72929) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Creating instance directory {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 26 22:32:02 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Creating image(s)
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Did not create local disks {{(pid=72929) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Ensure instance console log exists: /opt/stack/data/nova/instances/f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc/console.log {{(pid=72929) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Start _get_guest_xml network_info=[{"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'beb86fd6-f0d0-4504-8ae4-dde815ed81b1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zigJsTGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc', 'attached_at': '', 'detached_at': '', 'volume_id': 'edf45021-7344-46e1-80dc-35b2e074b49f', 'serial': 'edf45021-7344-46e1-80dc-35b2e074b49f'}, 'boot_index': 0, 'volume_type': None} {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 26 22:32:02 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:32:02 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller missing on host. {{(pid=72929) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.host [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU controller found on host. {{(pid=72929) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72929) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-26T21:53:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image limits 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flavor pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Image pref 0:0:0 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72929) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Got 1 possible topologies {{(pid=72929) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.hardware [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72929) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Calling os-brick to attach iSCSI Volume {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zigJsTGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:32:02 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:32:02 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:32:02 user nova-compute[72929]: INFO os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a121e-f7b5-4f94-967f-e2a151028e67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 26 22:32:02 user nova-compute[72929]:  {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --interface default --op new {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55accbe-0e22-41fb-a6a9-0a534ee8b28b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f] added\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f] added
Aug 26 22:32:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e792b50-2df0-4818-9858-a1ac3a787bf1]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee50309-f151-418d-8d82-4e9d68516950]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zigJsTGE {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zigJsTGE" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd911081-7a8b-45a2-bdc0-fe8e90288fdd]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zigJsTGE'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d943da-d273-412e-9eff-d279896c1940]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4325b397-0168-444f-b57b-1375de2d8383]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:32:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:32:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --login {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e53a6c4-37ce-4c75-86d8-0a4f97ac124f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260]
Aug 26 22:32:02 user nova-compute[72929]: Login to [iface: default, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260] successful.
Aug 26 22:32:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[40802987-3173-4429-ac7a-82c407975f69]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[113bd234-a09a-4f9e-b461-e364005d7bbd]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:32:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:32:02 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:32:02 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to 172.16.0.220:3260 {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] HCTL ('36', '-', '-', 0) found on session 60 with lun 0 {{(pid=72929) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72929) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c72a666-9663-43f4-a2c5-e1781dff47a5]: (4, ('- - 0', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:02 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 60 and hctl ['36', '*', '*', 0] yield: None {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Searching for a device in session 60 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72929) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zigJsTGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72929) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26132643335653037', 'path': '/dev/sde'} {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132643335653037', 'path': '/dev/sde'} {{(pid=72929) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-652494912',display_name='tempest-TestVolumeBootPattern-server-652494912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-652494912',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-zga5uola',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:31:51Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72929) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.objects.instance [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'pci_devices' on Instance uuid f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] End _get_guest_xml xml=<domain type="kvm">
Aug 26 22:32:03 user nova-compute[72929]:   <uuid>f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc</uuid>
Aug 26 22:32:03 user nova-compute[72929]:   <name>instance-00000034</name>
Aug 26 22:32:03 user nova-compute[72929]:   <memory>524288</memory>
Aug 26 22:32:03 user nova-compute[72929]:   <vcpu>1</vcpu>
Aug 26 22:32:03 user nova-compute[72929]:   <metadata>
Aug 26 22:32:03 user nova-compute[72929]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 26 22:32:03 user nova-compute[72929]:       <nova:package version="0.0.0"/>
Aug 26 22:32:03 user nova-compute[72929]:       <nova:name>tempest-TestVolumeBootPattern-server-652494912</nova:name>
Aug 26 22:32:03 user nova-compute[72929]:       <nova:creationTime>2023-08-26 22:32:02</nova:creationTime>
Aug 26 22:32:03 user nova-compute[72929]:       <nova:flavor name="m1.tiny">
Aug 26 22:32:03 user nova-compute[72929]:         <nova:memory>512</nova:memory>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:disk>1</nova:disk>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:swap>0</nova:swap>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:ephemeral>0</nova:ephemeral>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:vcpus>1</nova:vcpus>
Aug 26 22:32:03 user nova-compute[72929]:       </nova:flavor>
Aug 26 22:32:03 user nova-compute[72929]:       <nova:owner>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:user uuid="cf31c30629f7485a9b160f8d853096dc">tempest-TestVolumeBootPattern-1716061349-project-member</nova:user>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:project uuid="ea6b106b16484bfa8fd629b57527130f">tempest-TestVolumeBootPattern-1716061349</nova:project>
Aug 26 22:32:03 user nova-compute[72929]:       </nova:owner>
Aug 26 22:32:03 user nova-compute[72929]:       <nova:ports>
Aug 26 22:32:03 user nova-compute[72929]:         <nova:port uuid="34737c17-0cbb-4c88-b17e-24c6826b6e71">
Aug 26 22:32:03 user nova-compute[72929]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 26 22:32:03 user nova-compute[72929]:         </nova:port>
Aug 26 22:32:03 user nova-compute[72929]:       </nova:ports>
Aug 26 22:32:03 user nova-compute[72929]:     </nova:instance>
Aug 26 22:32:03 user nova-compute[72929]:   </metadata>
Aug 26 22:32:03 user nova-compute[72929]:   <sysinfo type="smbios">
Aug 26 22:32:03 user nova-compute[72929]:     <system>
Aug 26 22:32:03 user nova-compute[72929]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 26 22:32:03 user nova-compute[72929]:       <entry name="product">OpenStack Nova</entry>
Aug 26 22:32:03 user nova-compute[72929]:       <entry name="version">0.0.0</entry>
Aug 26 22:32:03 user nova-compute[72929]:       <entry name="serial">f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc</entry>
Aug 26 22:32:03 user nova-compute[72929]:       <entry name="uuid">f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc</entry>
Aug 26 22:32:03 user nova-compute[72929]:       <entry name="family">Virtual Machine</entry>
Aug 26 22:32:03 user nova-compute[72929]:     </system>
Aug 26 22:32:03 user nova-compute[72929]:   </sysinfo>
Aug 26 22:32:03 user nova-compute[72929]:   <os>
Aug 26 22:32:03 user nova-compute[72929]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 26 22:32:03 user nova-compute[72929]:     <boot dev="hd"/>
Aug 26 22:32:03 user nova-compute[72929]:     <smbios mode="sysinfo"/>
Aug 26 22:32:03 user nova-compute[72929]:   </os>
Aug 26 22:32:03 user nova-compute[72929]:   <features>
Aug 26 22:32:03 user nova-compute[72929]:     <acpi/>
Aug 26 22:32:03 user nova-compute[72929]:     <apic/>
Aug 26 22:32:03 user nova-compute[72929]:     <vmcoreinfo/>
Aug 26 22:32:03 user nova-compute[72929]:   </features>
Aug 26 22:32:03 user nova-compute[72929]:   <clock offset="utc">
Aug 26 22:32:03 user nova-compute[72929]:     <timer name="pit" tickpolicy="delay"/>
Aug 26 22:32:03 user nova-compute[72929]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 26 22:32:03 user nova-compute[72929]:     <timer name="hpet" present="no"/>
Aug 26 22:32:03 user nova-compute[72929]:   </clock>
Aug 26 22:32:03 user nova-compute[72929]:   <cpu mode="custom" match="exact">
Aug 26 22:32:03 user nova-compute[72929]:     <model>Nehalem</model>
Aug 26 22:32:03 user nova-compute[72929]:     <topology sockets="1" cores="1" threads="1"/>
Aug 26 22:32:03 user nova-compute[72929]:   </cpu>
Aug 26 22:32:03 user nova-compute[72929]:   <devices>
Aug 26 22:32:03 user nova-compute[72929]:     <disk type="block" device="disk">
Aug 26 22:32:03 user nova-compute[72929]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:32:03 user nova-compute[72929]:       <source dev="/dev/sde"/>
Aug 26 22:32:03 user nova-compute[72929]:       <target dev="vda" bus="virtio"/>
Aug 26 22:32:03 user nova-compute[72929]:       <serial>edf45021-7344-46e1-80dc-35b2e074b49f</serial>
Aug 26 22:32:03 user nova-compute[72929]:     </disk>
Aug 26 22:32:03 user nova-compute[72929]:     <interface type="ethernet">
Aug 26 22:32:03 user nova-compute[72929]:       <mac address="fa:16:3e:46:b9:72"/>
Aug 26 22:32:03 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:32:03 user nova-compute[72929]:       <mtu size="1442"/>
Aug 26 22:32:03 user nova-compute[72929]:       <target dev="tap34737c17-0c"/>
Aug 26 22:32:03 user nova-compute[72929]:     </interface>
Aug 26 22:32:03 user nova-compute[72929]:     <serial type="pty">
Aug 26 22:32:03 user nova-compute[72929]:       <log file="/opt/stack/data/nova/instances/f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc/console.log" append="off"/>
Aug 26 22:32:03 user nova-compute[72929]:     </serial>
Aug 26 22:32:03 user nova-compute[72929]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 26 22:32:03 user nova-compute[72929]:     <video>
Aug 26 22:32:03 user nova-compute[72929]:       <model type="virtio"/>
Aug 26 22:32:03 user nova-compute[72929]:     </video>
Aug 26 22:32:03 user nova-compute[72929]:     <rng model="virtio">
Aug 26 22:32:03 user nova-compute[72929]:       <backend model="random">/dev/urandom</backend>
Aug 26 22:32:03 user nova-compute[72929]:     </rng>
Aug 26 22:32:03 user nova-compute[72929]:     <controller type="usb" index="0" model="none"/>
Aug 26 22:32:03 user nova-compute[72929]:     <memballoon model="virtio">
Aug 26 22:32:03 user nova-compute[72929]:       <stats period="10"/>
Aug 26 22:32:03 user nova-compute[72929]:     </memballoon>
Aug 26 22:32:03 user nova-compute[72929]:   </devices>
Aug 26 22:32:03 user nova-compute[72929]: </domain>
Aug 26 22:32:03 user nova-compute[72929]:  {{(pid=72929) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-652494912',display_name='tempest-TestVolumeBootPattern-server-652494912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-652494912',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-zga5uola',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-26T22:31:51Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG os_vif [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c') {{(pid=72929) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34737c17-0c, may_exist=True, interface_attrs={}) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap34737c17-0c, col_values=(('external_ids', {'iface-id': '34737c17-0cbb-4c88-b17e-24c6826b6e71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:b9:72', 'vm-uuid': 'f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc'}),), if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:03 user nova-compute[72929]: INFO os_vif [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c')
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No BDM found with device name vda, not building metadata. {{(pid=72929) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 26 22:32:03 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] No VIF found with MAC fa:16:3e:46:b9:72, not building metadata {{(pid=72929) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-50e4c8eb-8455-4703-b079-140d02cdb2e3 req-cb4f3277-4ca3-4dc1-9c1e-77efe0b470f2 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-50e4c8eb-8455-4703-b079-140d02cdb2e3 req-cb4f3277-4ca3-4dc1-9c1e-77efe0b470f2 service nova] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-50e4c8eb-8455-4703-b079-140d02cdb2e3 req-cb4f3277-4ca3-4dc1-9c1e-77efe0b470f2 service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-50e4c8eb-8455-4703-b079-140d02cdb2e3 req-cb4f3277-4ca3-4dc1-9c1e-77efe0b470f2 service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:05 user nova-compute[72929]: DEBUG nova.compute.manager [req-50e4c8eb-8455-4703-b079-140d02cdb2e3 req-cb4f3277-4ca3-4dc1-9c1e-77efe0b470f2 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] No waiting events found dispatching network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:05 user nova-compute[72929]: WARNING nova.compute.manager [req-50e4c8eb-8455-4703-b079-140d02cdb2e3 req-cb4f3277-4ca3-4dc1-9c1e-77efe0b470f2 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received unexpected event network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 for instance with vm_state building and task_state spawning.
Aug 26 22:32:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693089127.3383362, f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc => Resumed> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] VM Resumed (Lifecycle Event)
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Instance event wait completed in 0 seconds for  {{(pid=72929) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Guest created on hypervisor {{(pid=72929) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Instance spawned successfully.
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Found default for hw_cdrom_bus of ide {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Found default for hw_disk_bus of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Found default for hw_input_bus of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Found default for hw_pointer_model of None {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Found default for hw_video_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Found default for hw_vif_model of virtio {{(pid=72929) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.virt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Emitting event <LifecycleEvent: 1693089127.3398242, f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc => Started> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] VM Started (Lifecycle Event)
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72929) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.compute.manager [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-8ca75011-95d4-432d-a601-32a3e4e3d6ac req-d2911d85-d6f9-4803-9514-dfd82225425d service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8ca75011-95d4-432d-a601-32a3e4e3d6ac req-d2911d85-d6f9-4803-9514-dfd82225425d service nova] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8ca75011-95d4-432d-a601-32a3e4e3d6ac req-d2911d85-d6f9-4803-9514-dfd82225425d service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-8ca75011-95d4-432d-a601-32a3e4e3d6ac req-d2911d85-d6f9-4803-9514-dfd82225425d service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:07 user nova-compute[72929]: DEBUG nova.compute.manager [req-8ca75011-95d4-432d-a601-32a3e4e3d6ac req-d2911d85-d6f9-4803-9514-dfd82225425d service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] No waiting events found dispatching network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:07 user nova-compute[72929]: WARNING nova.compute.manager [req-8ca75011-95d4-432d-a601-32a3e4e3d6ac req-d2911d85-d6f9-4803-9514-dfd82225425d service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received unexpected event network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 for instance with vm_state building and task_state spawning.
Aug 26 22:32:07 user nova-compute[72929]: INFO nova.compute.manager [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Took 17.26 seconds to build instance.
Aug 26 22:32:07 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-17dbb9d3-7403-4831-a389-471e5f717d7c tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.349s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:32:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:19 user nova-compute[72929]: INFO nova.compute.manager [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Detaching volume b945b3e8-1dc8-41ea-afa5-ef3899e396cf
Aug 26 22:32:19 user nova-compute[72929]: INFO nova.virt.block_device [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Attempting to driver detach volume b945b3e8-1dc8-41ea-afa5-ef3899e396cf from mountpoint /dev/vdb
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Attempting to detach device vdb from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the persistent domain config. {{(pid=72929) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:32:19 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:32:19 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:32:19 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:32:19 user nova-compute[72929]:   <serial>b945b3e8-1dc8-41ea-afa5-ef3899e396cf</serial>
Aug 26 22:32:19 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:32:19 user nova-compute[72929]: </disk>
Aug 26 22:32:19 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:32:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Successfully detached device vdb from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the persistent domain config.
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the live domain config. {{(pid=72929) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.guest [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] detach device xml: <disk type="block" device="disk">
Aug 26 22:32:19 user nova-compute[72929]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 26 22:32:19 user nova-compute[72929]:   <source dev="/dev/sdc"/>
Aug 26 22:32:19 user nova-compute[72929]:   <target dev="vdb" bus="virtio"/>
Aug 26 22:32:19 user nova-compute[72929]:   <serial>b945b3e8-1dc8-41ea-afa5-ef3899e396cf</serial>
Aug 26 22:32:19 user nova-compute[72929]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 26 22:32:19 user nova-compute[72929]: </disk>
Aug 26 22:32:19 user nova-compute[72929]:  {{(pid=72929) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-5e0532b9-d33d-47ae-821b-516ef6e417d5 None None] Received event <DeviceRemovedEvent: 1693089139.80335, bbb086c5-5794-4855-ab1e-fec50e12751e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72929) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 26 22:32:19 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Successfully detached device vdb from instance bbb086c5-5794-4855-ab1e-fec50e12751e from the live domain config.
Aug 26 22:32:19 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAiPyBlr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:32:19 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e99779-4a6f-44e9-88e8-2979e79fa76d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a98220a6-158d-4168-b483-ce8fb81c04ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ee9d7d-90fe-467c-9357-972679586e80]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98220a6-158d-4168-b483-ce8fb81c04ea (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98220a6-158d-4168-b483-ce8fb81c04ea (non-flash)
Aug 26 22:32:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:32:19 user nova-compute[72929]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a98220a6-158d-4168-b483-ce8fb81c04ea (non-flash)
Aug 26 22:32:19 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b804d27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf'): ({'sdc'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Removing single pathed devices sdc {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[791d0cd1-1816-49c7-be78-262c50b71a85]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a722cc-1d1f-4da5-927b-27f1ee58b2ef]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Flushing IO for device /dev/sdc {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8f0b3b-b6b6-447b-8d60-974a3fb6e2be]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd2dd0-6f0f-4d54-af68-cb0f909546e6]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:32:19 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] SCSI volumes sdc have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17caed5-afdc-4a23-8a07-2b918cb58a0e]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b16a2f-56ee-4595-89c4-9a67d022ee49]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260]
Aug 26 22:32:20 user nova-compute[72929]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf, portal: 172.16.0.220,3260] successful.
Aug 26 22:32:20 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b945b3e8-1dc8-41ea-afa5-ef3899e396cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[758132ab-753a-4474-8780-689d35408b64]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] <== disconnect_volume: return (314ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG nova.objects.instance [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'flavor' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:32:20 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-d90839bf-2b37-46c5-85da-8d7063e8bc37 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:24 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:24 user nova-compute[72929]: INFO nova.compute.manager [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Terminating instance
Aug 26 22:32:24 user nova-compute[72929]: DEBUG nova.compute.manager [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-102fd22c-181f-4360-a242-7413ef5705b3 req-48c5eb97-c587-4637-a8b9-da57bb5ea2f5 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-102fd22c-181f-4360-a242-7413ef5705b3 req-48c5eb97-c587-4637-a8b9-da57bb5ea2f5 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-102fd22c-181f-4360-a242-7413ef5705b3 req-48c5eb97-c587-4637-a8b9-da57bb5ea2f5 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-102fd22c-181f-4360-a242-7413ef5705b3 req-48c5eb97-c587-4637-a8b9-da57bb5ea2f5 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-102fd22c-181f-4360-a242-7413ef5705b3 req-48c5eb97-c587-4637-a8b9-da57bb5ea2f5 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.compute.manager [req-102fd22c-181f-4360-a242-7413ef5705b3 req-48c5eb97-c587-4637-a8b9-da57bb5ea2f5 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Instance destroyed successfully.
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.objects.instance [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'resources' on Instance uuid 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:16:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1078351751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1078351751',id=36,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-kaq3z0gf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:20:24Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "address": "fa:16:3e:de:ea:57", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap481b80f1-1b", "ovs_interfaceid": "481b80f1-1b38-4cc5-a217-6a742bf6b0f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_vif [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap481b80f1-1b, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:25 user nova-compute[72929]: INFO os_vif [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ea:57,bridge_name='br-int',has_traffic_filtering=True,id=481b80f1-1b38-4cc5-a217-6a742bf6b0f1,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap481b80f1-1b')
Aug 26 22:32:25 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vheukKVP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:32:25 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953f8fd-813e-4fb7-9dc6-6e4fcfe6acc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ae984c-88bf-449b-8862-f6c169ecb571]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:25 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:25 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:32:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df (non-flash)
Aug 26 22:32:25 user nova-compute[72929]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:32:25 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:32:25 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b801a2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df'): ({'sdd'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Removing single pathed devices sdd {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4694014b-3fb8-4f96-9f74-78a2b6c31902]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c72c4-7063-4b1d-b5b2-d811b72444d9]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Flushing IO for device /dev/sdd {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec13a1-2a94-45cb-8641-cdf715796d02]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[393c0092-4fc9-4c25-85c8-feb6882109cc]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] SCSI volumes sdd have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:32:25 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba739c5-cd6b-42fc-abe2-24ff86f8a3a5]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b4a6f-7d34-42c7-afc1-4811455f17ff]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260]
Aug 26 22:32:26 user nova-compute[72929]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df, portal: 172.16.0.220,3260] successful.
Aug 26 22:32:26 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3bec2f0f-19dc-4a81-a4dd-a1fdb90ad0df -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62fac49-09d9-4775-b08a-5402e21910f8]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] <== disconnect_volume: return (302ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:32:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Deleting instance files /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1_del
Aug 26 22:32:26 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Deletion of /opt/stack/data/nova/instances/1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1_del complete
Aug 26 22:32:26 user nova-compute[72929]: INFO nova.compute.manager [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 26 22:32:26 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:32:27 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Took 0.93 seconds to deallocate network for instance.
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-dc666eaa-c489-44e5-b266-895d984ad8c3 req-0ba003c2-5d5f-4921-8d44-7de05febf582 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-deleted-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:27 user nova-compute[72929]: WARNING nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state deleting.
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:27 user nova-compute[72929]: WARNING nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state deleting.
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:27 user nova-compute[72929]: WARNING nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state deleting.
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-unplugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Acquiring lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] No waiting events found dispatching network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:32:27 user nova-compute[72929]: WARNING nova.compute.manager [req-55326d84-e5d3-4d96-a00b-620f0741ab28 req-6ccf6ee4-3ef9-43a2-a6b9-1082ecd73df7 service nova] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Received unexpected event network-vif-plugged-481b80f1-1b38-4cc5-a217-6a742bf6b0f1 for instance with vm_state active and task_state deleting.
Aug 26 22:32:27 user nova-compute[72929]: INFO nova.compute.manager [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Took 0.79 seconds to detach 1 volumes for instance.
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:27 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:28 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:32:28 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:32:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:28 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Deleted allocations for instance 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1
Aug 26 22:32:28 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-bef7c84a-e3c8-4b41-82dc-32dfc547832d tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:40 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089145.7340534, 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:32:40 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] VM Stopped (Lifecycle Event)
Aug 26 22:32:40 user nova-compute[72929]: DEBUG nova.compute.manager [None req-b6d74d96-0f23-4043-a798-0173ae4d2c67 None None] [instance: 1bd35fa8-0ab1-47c7-a495-cf8cdf5aacd1] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:32:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:32:42 user nova-compute[72929]: DEBUG nova.objects.instance [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lazy-loading 'info_cache' on Instance uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:32:43 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [{"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:32:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-f7399401-da4d-484f-ab62-7cc07d8ab8a4" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:32:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:32:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:32:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:46 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:32:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:32:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8340MB free_disk=23.892623901367188GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bbb086c5-5794-4855-ab1e-fec50e12751e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3cf6093e-f951-4b92-82ce-1631321dae07 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:32:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:32:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:32:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:32:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:32:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:32:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:32:57 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:33:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:33:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:33:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:01 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Verify base images {{(pid=72929) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72929) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Image id 004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3 yields fingerprint bb23afc88b697142003c0bd924a7bd6e4b9a0051 {{(pid=72929) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] image 004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3 at (/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051): checking
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] image 004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3 at (/opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051): image is in use {{(pid=72929) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] bbb086c5-5794-4855-ab1e-fec50e12751e is a valid instance name {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] bbb086c5-5794-4855-ab1e-fec50e12751e has a disk file {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance bbb086c5-5794-4855-ab1e-fec50e12751e is backed by bb23afc88b697142003c0bd924a7bd6e4b9a0051 {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] 3cf6093e-f951-4b92-82ce-1631321dae07 is a valid instance name {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc is a valid instance name {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] f7399401-da4d-484f-ab62-7cc07d8ab8a4 is a valid instance name {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] f7399401-da4d-484f-ab62-7cc07d8ab8a4 has a disk file {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.compute.manager [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Terminating instance
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72929) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance f7399401-da4d-484f-ab62-7cc07d8ab8a4 is backed by bb23afc88b697142003c0bd924a7bd6e4b9a0051 {{(pid=72929) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8
Aug 26 22:33:09 user nova-compute[72929]: WARNING nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Unknown base file: /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Active base files: /opt/stack/data/nova/instances/_base/bb23afc88b697142003c0bd924a7bd6e4b9a0051
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Removable base files: /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9 /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2 /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8 /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4 /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8 /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c8a75d0d3ee0c779ec42d7ef66acbb5c2c35902d
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c1d2e0ddb66bdf594a65b22f907f4d86beeb7ba9
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ae8761f6803ddb0f4efb2bc6c4739fc90112e2c
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/146f5d65494e58ae0ce01f23d3b4f54e2ff201e2
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad58f47e8d7c72a0e3dbce9bf4bd3b9e14c51bd8
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f73e55f59076beefe2686581ba387b035fb82b5f
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/18e991994d37a8ecae21c71e867a657c9a4f70b4
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6a161f011ec22a7d3cfa2b2fd3bbb13c287291d8
Aug 26 22:33:09 user nova-compute[72929]: INFO nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/af854739c4dc31a42356791069713919bccaa59d
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Verification complete {{(pid=72929) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Verify swap images {{(pid=72929) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG nova.virt.libvirt.imagecache [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Verify ephemeral images {{(pid=72929) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-af30503f-54f0-47ef-8ff8-0f02e1b8b76c req-8985256f-1b25-441f-a8da-206189ca8cd2 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-unplugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-af30503f-54f0-47ef-8ff8-0f02e1b8b76c req-8985256f-1b25-441f-a8da-206189ca8cd2 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-af30503f-54f0-47ef-8ff8-0f02e1b8b76c req-8985256f-1b25-441f-a8da-206189ca8cd2 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-af30503f-54f0-47ef-8ff8-0f02e1b8b76c req-8985256f-1b25-441f-a8da-206189ca8cd2 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-af30503f-54f0-47ef-8ff8-0f02e1b8b76c req-8985256f-1b25-441f-a8da-206189ca8cd2 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-unplugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.compute.manager [req-af30503f-54f0-47ef-8ff8-0f02e1b8b76c req-8985256f-1b25-441f-a8da-206189ca8cd2 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-unplugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Instance destroyed successfully.
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lazy-loading 'resources' on Instance uuid bbb086c5-5794-4855-ab1e-fec50e12751e {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2096110074',display_name='tempest-TestServerVolumeAttachmentScenario-server-2096110074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2096110074',id=50,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDaIhi7MJ1f/Th+mIkNVrZ50Xxqk9FvNZFn354V9udtpF6JF4vKAByKU3e6CZaRv7O73W35rISuj0/XjeAu/geXtKOejcgWCcdbb6s4PBSyMrxqznxwJlrv+zfGCx04xsQ==',key_name='tempest-keypair-477967582',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:29:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909e305b15ed42f8825eaa3d4c51057d',ramdisk_id='',reservation_id='r-spa809fa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1100081246',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1100081246-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9aebd4001cf54f8c8114ab742f4242ec',uuid=bbb086c5-5794-4855-ab1e-fec50e12751e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Converting VIF {"id": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "address": "fa:16:3e:9e:4d:fe", "network": {"id": "1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-482418905-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909e305b15ed42f8825eaa3d4c51057d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4c193bab-16", "ovs_interfaceid": "4c193bab-16ea-4313-bbdf-5c8a78f1543f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG os_vif [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4c193bab-16, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:10 user nova-compute[72929]: INFO os_vif [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:4d:fe,bridge_name='br-int',has_traffic_filtering=True,id=4c193bab-16ea-4313-bbdf-5c8a78f1543f,network=Network(1f4b6aaa-11a9-45a0-a689-a8b29bc6ded0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4c193bab-16')
Aug 26 22:33:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Deleting instance files /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e_del
Aug 26 22:33:10 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Deletion of /opt/stack/data/nova/instances/bbb086c5-5794-4855-ab1e-fec50e12751e_del complete
Aug 26 22:33:10 user nova-compute[72929]: INFO nova.compute.manager [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 26 22:33:10 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:33:10 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:33:11 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Took 1.23 seconds to deallocate network for instance.
Aug 26 22:33:11 user nova-compute[72929]: DEBUG nova.compute.manager [req-0dac5667-a707-43fe-9765-bf04d7805cd6 req-a5d249a8-e5bf-4dd8-81eb-e8dcb23d6a29 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-deleted-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:11 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:12 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Deleted allocations for instance bbb086c5-5794-4855-ab1e-fec50e12751e
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:12 user nova-compute[72929]: WARNING nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state deleted and task_state None.
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:12 user nova-compute[72929]: WARNING nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state deleted and task_state None.
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:12 user nova-compute[72929]: WARNING nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state deleted and task_state None.
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-unplugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-unplugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:12 user nova-compute[72929]: WARNING nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-unplugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state deleted and task_state None.
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Acquiring lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:12 user nova-compute[72929]: DEBUG nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] No waiting events found dispatching network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:12 user nova-compute[72929]: WARNING nova.compute.manager [req-47e3c28e-694d-46fa-b220-7218e89b4927 req-ef01ea43-8955-4c45-927b-40546897db73 service nova] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Received unexpected event network-vif-plugged-4c193bab-16ea-4313-bbdf-5c8a78f1543f for instance with vm_state deleted and task_state None.
Aug 26 22:33:12 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4717a3c5-b382-4a85-af51-b99f74334e88 tempest-TestServerVolumeAttachmentScenario-1100081246 tempest-TestServerVolumeAttachmentScenario-1100081246-project-member] Lock "bbb086c5-5794-4855-ab1e-fec50e12751e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:15 user nova-compute[72929]: INFO nova.compute.manager [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Terminating instance
Aug 26 22:33:15 user nova-compute[72929]: DEBUG nova.compute.manager [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-7c82cd0d-68b7-4aa0-8160-e6e38e2bb498 req-c5ac2f85-246d-4b77-b050-e935045b6867 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-vif-unplugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7c82cd0d-68b7-4aa0-8160-e6e38e2bb498 req-c5ac2f85-246d-4b77-b050-e935045b6867 service nova] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7c82cd0d-68b7-4aa0-8160-e6e38e2bb498 req-c5ac2f85-246d-4b77-b050-e935045b6867 service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-7c82cd0d-68b7-4aa0-8160-e6e38e2bb498 req-c5ac2f85-246d-4b77-b050-e935045b6867 service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-7c82cd0d-68b7-4aa0-8160-e6e38e2bb498 req-c5ac2f85-246d-4b77-b050-e935045b6867 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] No waiting events found dispatching network-vif-unplugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.compute.manager [req-7c82cd0d-68b7-4aa0-8160-e6e38e2bb498 req-c5ac2f85-246d-4b77-b050-e935045b6867 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-vif-unplugged-d89228c0-216f-4eba-a8b3-470f5aca003a for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:33:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Instance destroyed successfully.
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.objects.instance [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lazy-loading 'resources' on Instance uuid f7399401-da4d-484f-ab62-7cc07d8ab8a4 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:13:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1551348386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1551348386',id=33,image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcc89a603c20492d9a2f41085f0e10f5',ramdisk_id='',reservation_id='r-gb82att6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='004fda8d-a5fb-4c9d-99b3-c7418d5f3bb3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-650830425',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:15:35Z,user_data=None,user_id='cc2833663e85431fa3433a128520c8a8',uuid=f7399401-da4d-484f-ab62-7cc07d8ab8a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converting VIF {"id": "d89228c0-216f-4eba-a8b3-470f5aca003a", "address": "fa:16:3e:22:42:e2", "network": {"id": "bb00abe1-42e8-40b8-82bf-67486693b7ec", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-278788291-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcc89a603c20492d9a2f41085f0e10f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd89228c0-21", "ovs_interfaceid": "d89228c0-216f-4eba-a8b3-470f5aca003a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG os_vif [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd89228c0-21, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:16 user nova-compute[72929]: INFO os_vif [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:42:e2,bridge_name='br-int',has_traffic_filtering=True,id=d89228c0-216f-4eba-a8b3-470f5aca003a,network=Network(bb00abe1-42e8-40b8-82bf-67486693b7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd89228c0-21')
Aug 26 22:33:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Deleting instance files /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4_del
Aug 26 22:33:16 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Deletion of /opt/stack/data/nova/instances/f7399401-da4d-484f-ab62-7cc07d8ab8a4_del complete
Aug 26 22:33:16 user nova-compute[72929]: INFO nova.compute.manager [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 26 22:33:16 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:33:16 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:33:17 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:33:17 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Took 0.52 seconds to deallocate network for instance.
Aug 26 22:33:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:17 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:33:17 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:33:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:17 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Deleted allocations for instance f7399401-da4d-484f-ab62-7cc07d8ab8a4
Aug 26 22:33:17 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-3975d354-2fda-4017-8566-7907ce8c4af5 tempest-ServerBootFromVolumeStableRescueTest-650830425 tempest-ServerBootFromVolumeStableRescueTest-650830425-project-member] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.684s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] Acquiring lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:18 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] Lock "f7399401-da4d-484f-ab62-7cc07d8ab8a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] No waiting events found dispatching network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:18 user nova-compute[72929]: WARNING nova.compute.manager [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received unexpected event network-vif-plugged-d89228c0-216f-4eba-a8b3-470f5aca003a for instance with vm_state deleted and task_state None.
Aug 26 22:33:18 user nova-compute[72929]: DEBUG nova.compute.manager [req-71cd5e95-d2fa-4bd4-a90f-f9176ca2b226 req-d14c42ff-de51-4daa-bed1-21cd983b3764 service nova] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Received event network-vif-deleted-d89228c0-216f-4eba-a8b3-470f5aca003a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:25 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089190.497004, bbb086c5-5794-4855-ab1e-fec50e12751e => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:33:25 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] VM Stopped (Lifecycle Event)
Aug 26 22:33:25 user nova-compute[72929]: DEBUG nova.compute.manager [None req-2ee00cb6-eff9-46a7-a696-f6506be98e03 None None] [instance: bbb086c5-5794-4855-ab1e-fec50e12751e] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:33:26 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089196.4835072, f7399401-da4d-484f-ab62-7cc07d8ab8a4 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:33:31 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] VM Stopped (Lifecycle Event)
Aug 26 22:33:31 user nova-compute[72929]: DEBUG nova.compute.manager [None req-98c36f97-9d98-4558-bdce-833ed933c2a7 None None] [instance: f7399401-da4d-484f-ab62-7cc07d8ab8a4] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:33:31 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:36 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:41 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-changed-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG nova.compute.manager [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Refreshing instance network info cache due to event network-changed-34737c17-0cbb-4c88-b17e-24c6826b6e71. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] Acquiring lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] Acquired lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Refreshing network info cache for port 34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updated VIF entry in instance network info cache for port 34737c17-0cbb-4c88-b17e-24c6826b6e71. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG nova.network.neutron [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updating instance_info_cache with network_info: [{"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:33:42 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a5db7418-0b34-433b-b890-c13981085df1 req-c2548098-f3f2-4075-99a6-f6c6634c19ab service nova] Releasing lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:43 user nova-compute[72929]: INFO nova.compute.manager [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Terminating instance
Aug 26 22:33:43 user nova-compute[72929]: DEBUG nova.compute.manager [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:43 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Instance destroyed successfully.
Aug 26 22:33:43 user nova-compute[72929]: DEBUG nova.objects.instance [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'resources' on Instance uuid f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:31:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-652494912',display_name='tempest-TestVolumeBootPattern-server-652494912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-652494912',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-zga5uola',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:32:07Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_vif [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34737c17-0c, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:43 user nova-compute[72929]: INFO os_vif [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:b9:72,bridge_name='br-int',has_traffic_filtering=True,id=34737c17-0cbb-4c88-b17e-24c6826b6e71,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34737c17-0c')
Aug 26 22:33:43 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zigJsTGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:33:43 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad1caf1-830b-4412-bbd7-d645741ffb0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc2eff-83d1-4f76-90f6-cf70fd8ee325]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:33:43 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:33:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:33:43 user nova-compute[72929]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f (non-flash)
Aug 26 22:33:43 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b801892d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f'): ({'sde'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Removing single pathed devices sde {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f8b53-739a-423f-b6a5-d4275b9ca588]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e912118-85cf-40e1-ba76-99a842aafca4]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flushing IO for device /dev/sde {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:33:43 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27e8a7e-2e1c-48a3-af45-830852a86ce7]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.171s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[7573e15e-690f-4353-8325-94ac9cd3706e]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] SCSI volumes sde have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d51d67-c766-462e-a440-c2a2d8e0b43f]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-changed-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Refreshing instance network info cache due to event network-changed-34737c17-0cbb-4c88-b17e-24c6826b6e71. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Acquiring lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Acquired lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Refreshing network info cache for port 34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[073cd9bc-e9b9-490d-b32b-a609294c833a]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260]
Aug 26 22:33:44 user nova-compute[72929]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f, portal: 172.16.0.220,3260] successful.
Aug 26 22:33:44 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edf45021-7344-46e1-80dc-35b2e074b49f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc387d-d001-4431-977d-228aa89b2e49]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== disconnect_volume: return (408ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:33:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Deleting instance files /opt/stack/data/nova/instances/f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc_del
Aug 26 22:33:44 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Deletion of /opt/stack/data/nova/instances/f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc_del complete
Aug 26 22:33:44 user nova-compute[72929]: INFO nova.compute.manager [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updated VIF entry in instance network info cache for port 34737c17-0cbb-4c88-b17e-24c6826b6e71. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.network.neutron [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updating instance_info_cache with network_info: [{"id": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "address": "fa:16:3e:46:b9:72", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34737c17-0c", "ovs_interfaceid": "34737c17-0cbb-4c88-b17e-24c6826b6e71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Releasing lock "refresh_cache-f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-vif-unplugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] No waiting events found dispatching network-vif-unplugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-vif-unplugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Acquiring lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] No waiting events found dispatching network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:33:44 user nova-compute[72929]: WARNING nova.compute.manager [req-4f58d731-fba6-47d3-9043-0c4fda0244c0 req-df301036-a38d-45df-9d83-488782c86549 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received unexpected event network-vif-plugged-34737c17-0cbb-4c88-b17e-24c6826b6e71 for instance with vm_state active and task_state deleting.
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:33:44 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Took 0.51 seconds to deallocate network for instance.
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquired lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:33:44 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Forcefully refreshing network info cache for instance {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 26 22:33:45 user nova-compute[72929]: INFO nova.compute.manager [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Took 0.83 seconds to detach 1 volumes for instance.
Aug 26 22:33:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:45 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:33:45 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:33:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:45 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Deleted allocations for instance f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc
Aug 26 22:33:45 user nova-compute[72929]: DEBUG nova.network.neutron [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating instance_info_cache with network_info: [{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:33:45 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Releasing lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:33:45 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updated the network info_cache for instance {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 26 22:33:46 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-40942103-d919-4fb4-a575-e0528f6519a3 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:46 user nova-compute[72929]: DEBUG nova.compute.manager [req-d676ed19-b033-4716-b12b-37c25622d96b req-f7eff626-b322-44a8-bcb1-b969c4e4f224 service nova] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Received event network-vif-deleted-34737c17-0cbb-4c88-b17e-24c6826b6e71 {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:33:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:33:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:33:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:33:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=24.036418914794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3cf6093e-f951-4b92-82ce-1631321dae07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_power_states {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Triggering sync for uuid 3cf6093e-f951-4b92-82ce-1631321dae07 {{(pid=72929) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "3cf6093e-f951-4b92-82ce-1631321dae07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "3cf6093e-f951-4b92-82ce-1631321dae07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:51 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:53 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:33:54 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:56 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:33:58 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089223.842688, f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:33:58 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] VM Stopped (Lifecycle Event)
Aug 26 22:33:58 user nova-compute[72929]: DEBUG nova.compute.manager [None req-55136d56-e0e4-4f96-9c83-1f8aca98f572 None None] [instance: f6f45d50-5452-4aaf-9bab-b07f6c0cfbdc] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:33:58 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:33:59 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:02 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:02 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:34:03 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 26 22:34:03 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] There are 0 instances to clean {{(pid=72929) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 26 22:34:03 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:08 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:13 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:18 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:21 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:23 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:34:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:34:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:34:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:34:28 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:33 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:34:38 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:43 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:44 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:34:44 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:34:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72929) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 26 22:34:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:34:47 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8795MB free_disk=24.033958435058594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Instance 3cf6093e-f951-4b92-82ce-1631321dae07 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72929) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing inventories for resource provider 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating ProviderTree inventory for provider 2fc6464f-291c-4428-855f-57fcef178e83 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Updating inventory in ProviderTree for provider 2fc6464f-291c-4428-855f-57fcef178e83 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 26 22:34:47 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing aggregate associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, aggregates: None {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Refreshing trait associations for resource provider 2fc6464f-291c-4428-855f-57fcef178e83, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VOLUME_EXTEND,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_RAW {{(pid=72929) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-changed-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.compute.manager [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Refreshing instance network info cache due to event network-changed-e38037fc-9ab2-45c9-862a-ea173e58107a. {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] Acquiring lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] Acquired lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 26 22:34:48 user nova-compute[72929]: DEBUG nova.network.neutron [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Refreshing network info cache for port e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "3cf6093e-f951-4b92-82ce-1631321dae07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:49 user nova-compute[72929]: INFO nova.compute.manager [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Terminating instance
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.compute.manager [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Start destroying the instance on the hypervisor. {{(pid=72929) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-d3e4601b-e4cf-4a55-a2a4-d17b24f53f19 req-0737596e-ed3e-45c4-814a-0e98e30f222d service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-vif-unplugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d3e4601b-e4cf-4a55-a2a4-d17b24f53f19 req-0737596e-ed3e-45c4-814a-0e98e30f222d service nova] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d3e4601b-e4cf-4a55-a2a4-d17b24f53f19 req-0737596e-ed3e-45c4-814a-0e98e30f222d service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-d3e4601b-e4cf-4a55-a2a4-d17b24f53f19 req-0737596e-ed3e-45c4-814a-0e98e30f222d service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-d3e4601b-e4cf-4a55-a2a4-d17b24f53f19 req-0737596e-ed3e-45c4-814a-0e98e30f222d service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] No waiting events found dispatching network-vif-unplugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.compute.manager [req-d3e4601b-e4cf-4a55-a2a4-d17b24f53f19 req-0737596e-ed3e-45c4-814a-0e98e30f222d service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-vif-unplugged-e38037fc-9ab2-45c9-862a-ea173e58107a for instance with task_state deleting. {{(pid=72929) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updated VIF entry in instance network info cache for port e38037fc-9ab2-45c9-862a-ea173e58107a. {{(pid=72929) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.network.neutron [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating instance_info_cache with network_info: [{"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-a1383c6f-ee07-4bc9-8d0d-9e0902078fdf req-61671a05-4148-4e5c-8daa-ca0ad125c0a2 service nova] Releasing lock "refresh_cache-3cf6093e-f951-4b92-82ce-1631321dae07" {{(pid=72929) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 26 22:34:49 user nova-compute[72929]: INFO nova.virt.libvirt.driver [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Instance destroyed successfully.
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.objects.instance [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lazy-loading 'resources' on Instance uuid 3cf6093e-f951-4b92-82ce-1631321dae07 {{(pid=72929) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.vif [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-26T22:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-884145443',display_name='tempest-TestVolumeBootPattern-server-884145443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-884145443',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrq6uEn9zH8ueLEdX62xBsa/r63YpvIwVux3F7YXuDo+VnpjOtwH3WXCNYQ4VSy6T6xd+Za0jc7yXNbbW87U2ldp7Hc1KnRoRmXEeml37tk35MjCu64z2BF4WE5fvS7sA==',key_name='tempest-TestVolumeBootPattern-2046249535',keypairs=<?>,launch_index=0,launched_at=2023-08-26T22:29:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea6b106b16484bfa8fd629b57527130f',ramdisk_id='',reservation_id='r-tc9h97li',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1716061349',owner_user_name='tempest-TestVolumeBootPattern-1716061349-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-26T22:29:59Z,user_data=None,user_id='cf31c30629f7485a9b160f8d853096dc',uuid=3cf6093e-f951-4b92-82ce-1631321dae07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converting VIF {"id": "e38037fc-9ab2-45c9-862a-ea173e58107a", "address": "fa:16:3e:b5:a8:83", "network": {"id": "246d0cca-61ef-45cd-958d-32c76e2aa542", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1134101083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea6b106b16484bfa8fd629b57527130f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape38037fc-9a", "ovs_interfaceid": "e38037fc-9ab2-45c9-862a-ea173e58107a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.network.os_vif_util [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a') {{(pid=72929) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_vif [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a') {{(pid=72929) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape38037fc-9a, bridge=br-int, if_exists=True) {{(pid=72929) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:34:49 user nova-compute[72929]: INFO os_vif [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:a8:83,bridge_name='br-int',has_traffic_filtering=True,id=e38037fc-9ab2-45c9-862a-ea173e58107a,network=Network(246d0cca-61ef-45cd-958d-32c76e2aa542),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape38037fc-9a')
Aug 26 22:34:49 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] calling os-brick to detach iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0b982d45b0>, {'target_iqns': ['iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bdQWPxoA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 26 22:34:49 user nova-compute[72929]: WARNING os_brick.initiator.connectors.base [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493', 0)] {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ed748-77b6-410a-8edd-ea8f391fa3a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efde49d-3152-4e5e-944d-3866532f9b9b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:34:49 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 (non-flash)
Aug 26 22:34:49 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0b8025e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493'): ({'sdb'}, set())}) {{(pid=72929) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Removing single pathed devices sdb {{(pid=72929) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[b159cbd9-0ba7-4bc4-9ca9-a808217720ae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:49 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5a0e6-f7fb-44da-9027-dcf093f9354b]: (4, ('ok\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Flushing IO for device /dev/sdb {{(pid=72929) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a76c1c-7163-4af7-91ef-1c982112d759]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72929) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b92636c-c028-494d-82a9-51d82c64eca4]: (4, ('1', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.linuxscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] SCSI volumes sdb have been removed. {{(pid=72929) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ab2533ed', '/dev/disk/by-id/scsi-1SCST_BIOab2533ed-80d2922798e9dff9', '/dev/disk/by-id/scsi-23830643239323237') {{(pid=84150) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4c3b1d-c910-4069-b596-1c76f6e70e36]: (4, None) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493')] {{(pid=72929) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90223fc-6eec-4118-91fa-d64cb65f0a09]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --logout {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa88997-a19c-4a17-a11f-5ff934721c21]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260]
Aug 26 22:34:50 user nova-compute[72929]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493, portal: 172.16.0.220,3260] successful.
Aug 26 22:34:50 user nova-compute[72929]:  stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op delete {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f845783e-a528-4e8a-8c71-854c428ef493 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84150) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.privsep.daemon [-] privsep: reply[20809603-9e0e-48b9-b977-b41f5e1611c2]: (4, ('', '')) {{(pid=84150) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72929) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.base [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] <== disconnect_volume: return (304ms) None {{(pid=72929) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Disconnected iSCSI Volume {{(pid=72929) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 26 22:34:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Deleting instance files /opt/stack/data/nova/instances/3cf6093e-f951-4b92-82ce-1631321dae07_del
Aug 26 22:34:50 user nova-compute[72929]: INFO nova.virt.libvirt.driver [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Deletion of /opt/stack/data/nova/instances/3cf6093e-f951-4b92-82ce-1631321dae07_del complete
Aug 26 22:34:50 user nova-compute[72929]: INFO nova.compute.manager [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 26 22:34:50 user nova-compute[72929]: DEBUG oslo.service.loopingcall [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72929) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG nova.compute.manager [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Deallocating network for instance {{(pid=72929) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] deallocate_for_instance() {{(pid=72929) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 26 22:34:50 user nova-compute[72929]: DEBUG nova.network.neutron [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Updating instance_info_cache with network_info: [] {{(pid=72929) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 26 22:34:50 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Took 0.46 seconds to deallocate network for instance.
Aug 26 22:34:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-7c751474-6880-4565-9e0e-698dc343f12b req-8ca329e4-d79b-41af-b576-fe84af2309aa service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-vif-deleted-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-ae7dc23b-5b0d-4d84-9c42-405206269240 req-58b23289-6ef5-48ce-8c09-35aa1fa94a46 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received event network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ae7dc23b-5b0d-4d84-9c42-405206269240 req-58b23289-6ef5-48ce-8c09-35aa1fa94a46 service nova] Acquiring lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ae7dc23b-5b0d-4d84-9c42-405206269240 req-58b23289-6ef5-48ce-8c09-35aa1fa94a46 service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [req-ae7dc23b-5b0d-4d84-9c42-405206269240 req-58b23289-6ef5-48ce-8c09-35aa1fa94a46 service nova] Lock "3cf6093e-f951-4b92-82ce-1631321dae07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG nova.compute.manager [req-ae7dc23b-5b0d-4d84-9c42-405206269240 req-58b23289-6ef5-48ce-8c09-35aa1fa94a46 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] No waiting events found dispatching network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a {{(pid=72929) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 26 22:34:51 user nova-compute[72929]: WARNING nova.compute.manager [req-ae7dc23b-5b0d-4d84-9c42-405206269240 req-58b23289-6ef5-48ce-8c09-35aa1fa94a46 service nova] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Received unexpected event network-vif-plugged-e38037fc-9ab2-45c9-862a-ea173e58107a for instance with vm_state active and task_state deleting.
Aug 26 22:34:51 user nova-compute[72929]: INFO nova.compute.manager [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Took 0.91 seconds to detach 1 volumes for instance.
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:51 user nova-compute[72929]: INFO nova.scheduler.client.report [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Deleted allocations for instance 3cf6093e-f951-4b92-82ce-1631321dae07
Aug 26 22:34:51 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-4f9086ff-46e5-463f-a48e-da93e2f32b50 tempest-TestVolumeBootPattern-1716061349 tempest-TestVolumeBootPattern-1716061349-project-member] Lock "3cf6093e-f951-4b92-82ce-1631321dae07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.894s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:34:52 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:53 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:34:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:34:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:34:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:34:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:34:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:34:59 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:00 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:04 user nova-compute[72929]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1693089289.8593, 3cf6093e-f951-4b92-82ce-1631321dae07 => Stopped> {{(pid=72929) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 26 22:35:04 user nova-compute[72929]: INFO nova.compute.manager [-] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] VM Stopped (Lifecycle Event)
Aug 26 22:35:04 user nova-compute[72929]: DEBUG nova.compute.manager [None req-44110b66-1c00-4f22-9fbe-b0b835cc16c8 None None] [instance: 3cf6093e-f951-4b92-82ce-1631321dae07] Checking state {{(pid=72929) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 26 22:35:04 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:09 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:14 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:19 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:35:24 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:35:29 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:34 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:39 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:44 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:35:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:35:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:35:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:49 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:35:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:35:49 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:35:49 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:35:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:35:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.032264709472656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:35:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:35:51 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:51 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:51 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:51 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:35:53 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:53 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:35:54 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:35:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:00 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:01 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:36:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:36:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:36:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:36:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:36:46 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:36:46 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:36:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:36:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=24.030380249023438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:36:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:36:54 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:36:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:36:55 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:00 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:02 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:37:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:37:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:37:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72929) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 26 22:37:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:37:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72929) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 26 22:37:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:37:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:37:48 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:37:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:48 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:37:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:37:50 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.029220581054688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:37:50 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:37:52 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:52 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:37:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:37:55 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:37:57 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:01 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:04 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:20 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:25 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:30 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:35 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:40 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:45 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Starting heal instance info cache {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Rebuilding the list of instances to heal {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Didn't find any instances for network info cache update. {{(pid=72929) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:50 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72929) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager.update_available_resource {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Auditing locally available compute resources for user (node: user) {{(pid=72929) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 26 22:38:52 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:38:52 user nova-compute[72929]: WARNING nova.virt.libvirt.driver [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 26 22:38:52 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.02001953125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72929) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 26 22:38:52 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 26 22:38:53 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 26 22:38:53 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72929) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 26 22:38:53 user nova-compute[72929]: DEBUG nova.compute.provider_tree [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed in ProviderTree for provider: 2fc6464f-291c-4428-855f-57fcef178e83 {{(pid=72929) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 26 22:38:53 user nova-compute[72929]: DEBUG nova.scheduler.client.report [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Inventory has not changed for provider 2fc6464f-291c-4428-855f-57fcef178e83 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72929) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 26 22:38:53 user nova-compute[72929]: DEBUG nova.compute.resource_tracker [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Compute_service record updated for user:user {{(pid=72929) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 26 22:38:53 user nova-compute[72929]: DEBUG oslo_concurrency.lockutils [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=72929) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 26 22:38:55 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:38:57 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:38:59 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:39:00 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:39:01 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:39:05 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 26 22:39:06 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:39:10 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 26 22:39:14 user nova-compute[72929]: DEBUG oslo_service.periodic_task [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72929) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 26 22:39:14 user nova-compute[72929]: DEBUG nova.compute.manager [None req-f3099d82-0d05-4f1f-8361-90e8318bf33d None None] Cleaning up deleted instances with incomplete migration  {{(pid=72929) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 26 22:39:15 user nova-compute[72929]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72929) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}